modular arithmetic
PulseAugur coverage of modular arithmetic — every cluster mentioning modular arithmetic across labs, papers, and developer communities, ranked by signal.
1 day(s) with sentiment data
-
New model explains neural network grokking by focusing on representability
Researchers have developed a new model to understand grokking in neural networks, a phenomenon where generalization is delayed. This model, using holomorphic monomial activations on modular arithmetic tasks, demonstrate…
-
New framework explains system convergence via phase transitions
Researchers have proposed a new framework called the Hierarchical Emergence Framework (HEF) to explain how complex systems, from machine learning to biology, converge on similar high-level structures. HEF models emergen…
-
Weight decay controls transformer training regimes, new diagnostics revealed
Researchers have identified weight decay as a key parameter controlling the training regimes of transformers on modular arithmetic tasks. They introduced two new, low-cost online diagnostics—mean pairwise attention-head…