ENTITY
signGD
signGD
PulseAugur coverage of signGD — every cluster mentioning signGD across labs, papers, and developer communities, ranked by signal.
Total · 30d
0
2 over 90d
Releases · 30d
0
0 over 90d
Papers · 30d
0
2 over 90d
TIER MIX · 90D
TOPICS
RECENT · PAGE 1/1 · 2 TOTAL
-
New SignGD model tackles class imbalance in language modeling
A new arXiv paper introduces SignGD, a minimal model designed to address class imbalance in machine learning, particularly in language modeling. The research, led by Robin Yadav, demonstrates that SignGD outperforms sta…
-
New theory explains heavy-tail emergence in neural optimizer dynamics
Researchers have developed a new method to understand how heavy-tailed spectral densities emerge in neural network weight matrices, which are indicators of implicit self-regularization. They formulated this emergence as…