Researchers have demonstrated that iterated narrow neural networks with a width of 4 can achieve Turing completeness. This means these networks, when iterated, can simulate any deterministic Turing machine. The study also shows that the complexity of verifying these networks spans the entire computational hierarchy, from NP-complete to undecidable, depending on the iteration bound. Furthermore, extending the width to 6 with common smooth activation functions like tanh or sigmoid also results in NP-complete verification problems. AI
IMPACT Establishes theoretical limits and capabilities of narrow neural networks, impacting understanding of their computational power.
RANK_REASON Academic paper detailing theoretical properties of neural networks. [lever_c_demoted from research: ic=1 ai=1.0]
Read on arXiv cs.NE (Neural & Evolutionary) →
- Elu
- Gelu
- hyperbolic tangent
- Neural ODEs
- NEXP-complete
- NP-complete
- RE-complete
- rectifier
- sigmoid function
- Swish
- Turing machine
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →