Signum
PulseAugur coverage of Signum — every cluster mentioning Signum across labs, papers, and developer communities, ranked by signal.
1 day(s) with sentiment data
-
New adaptive batch sizing method cuts training steps by up to 66%
Researchers have developed a new method for adaptive batch sizing in machine learning that accounts for the non-Euclidean geometry of optimizers like signSGD and spectral descent. This approach, which estimates non-Eucl…
-
Adam and Muon optimizers show implicit bias in neural networks
Researchers have analyzed the implicit bias of momentum-based optimizers like Adam and Muon when applied to smooth homogeneous neural networks. Their findings suggest that algorithms such as momentum steepest descent, i…
-
LionMuon optimizer cuts training cost for large models
Researchers have introduced LionMuon, a novel optimization algorithm designed for efficient training of large-scale models. This method alternates between the low-cost updates of Lion and the stronger, albeit more expen…