Newton-Schulz iteration
PulseAugur coverage of Newton-Schulz iteration — every cluster mentioning Newton-Schulz iteration across labs, papers, and developer communities, ranked by signal.
1 day(s) with sentiment data
-
Muon optimizer shows token efficiency gains on Mamba-2 130M
A new research paper explores the effectiveness of the Muon optimizer, which uses a Newton-Schulz iteration for steepest descent under the spectral norm, on state-space models. The study compares Muon with AdamW on the …
-
Muon optimizer's grokking speed attributed to orthogonalization, study finds
A new research paper published on arXiv details the active ingredient behind the Muon optimizer's faster grokking threshold in modular arithmetic compared to AdamW. The study isolates orthogonalization, specifically the…
-
New GUMP framework stabilizes graph neural networks with unitary propagation
Researchers have introduced Graph Unitary Message Passing (GUMP), a novel framework designed to stabilize deep neural networks, particularly in graph neural networks (GNNs). GUMP addresses instability issues arising fro…