ENTITY
Muon-SW
Muon-SW
PulseAugur coverage of Muon-SW — every cluster mentioning Muon-SW across labs, papers, and developer communities, ranked by signal.
Total · 30d
1
2 over 90d
Releases · 30d
0
0 over 90d
Papers · 30d
1
2 over 90d
TIER MIX · 90D
TOPICS
SENTIMENT · 30D
1 day(s) with sentiment data
RECENT · PAGE 1/1 · 2 TOTAL
-
Muon optimizer research reveals complex pretraining dynamics and fine-tuning trade-offs
Recent research explores the performance of the Muon optimizer in large language model pretraining, revealing nuanced behaviors that differ from classical gradient descent theories. One study indicates that Muon's dynam…
-
New scaled weight decay method accelerates neural network training
Researchers have introduced a novel method for scaling weight decay, inspired by the Robbins-Monro conditions, to improve neural network training. This technique adjusts weight decay based on the fraction of the peak le…