Ternary neural networks offer theoretical expressivity comparable to standard NNs

Researchers have theoretically analyzed the expressivity of ternary neural networks, which use parameters restricted to {-1, 0, +1}. The study focuses on regression networks with ReLU activation functions, proving that the number of linear regions grows polynomially with width and exponentially with depth. This theoretical understanding helps explain the practical success of ternary networks in applications like image recognition and natural language processing. AI

Summary written by gemini-2.5-flash-lite from 1 source. How we write summaries →

IMPACT Provides theoretical justification for the effectiveness of ternary neural networks, potentially guiding future research in efficient model design.

RANK_REASON Academic paper analyzing the theoretical properties of a specific type of neural network.

Read on arXiv cs.LG →

• Yuta Nakahara
• ReLU
• arXiv

• paper
• other