Schedule-Free
PulseAugur coverage of Schedule-Free — every cluster mentioning Schedule-Free across labs, papers, and developer communities, ranked by signal.
-
Schedule-Free optimization methods achieve optimal convergence rates in nonconvex settings
A new paper explores the theoretical underpinnings of Schedule-Free optimization methods in nonconvex settings, which are common in machine learning. The research provides worst-case convergence rate analyses for Schedu…
-
New Muon Optimizer Variants Enhance LLM Training Efficiency and Performance
Multiple research papers explore advancements and applications of the Muon optimizer for training large language models and other deep learning architectures. MONA introduces Nesterov acceleration to Muon for improved c…
-
Muon optimizer fails on convex Lipschitz functions, study finds
A new paper challenges the theoretical underpinnings of the Muon optimization algorithm, demonstrating that it does not converge on convex Lipschitz functions. The research suggests that Muon's practical success likely …