Dion
PulseAugur coverage of Dion — every cluster mentioning Dion across labs, papers, and developer communities, ranked by signal.
-
LionMuon optimizer cuts LLM pretraining costs with hybrid approach
Researchers have developed LionMuon, a novel optimizer designed to reduce the significant computational cost of pretraining large language models. LionMuon alternates between computationally expensive spectral steps, si…
-
Dion3 optimizer slashes AI training time by up to 6x
Researchers have developed Dion3, an optimized version of the Muon optimizer designed to reduce computational and communication overhead. The new algorithm, Gram Newton-Schulz, along with CuTeDSL kernels and a megabatch…
-
Dion3 optimizes Muon optimizer, achieving 6x speedup
Researchers have developed Dion3, an optimized version of the Muon optimizer that significantly reduces computational and communication overhead. By implementing algorithmic improvements like the Gram Newton-Schulz algo…