ENTITY
KL-Shampoo
KL-Shampoo
PulseAugur coverage of KL-Shampoo — every cluster mentioning KL-Shampoo across labs, papers, and developer communities, ranked by signal.
Total · 30d
2
2 over 90d
Releases · 30d
0
0 over 90d
Papers · 30d
2
2 over 90d
TIER MIX · 90D
TOPICS
RECENT · PAGE 1/1 · 2 TOTAL
-
New method boosts efficiency of neural network training algorithms
Researchers have developed a new method to reparametrize Shampoo and SOAP algorithms, improving their efficiency for training neural networks. This technique supports BFloat16 storage, which reduces memory usage, and mi…
-
Pro-KLShampoo optimizer improves LLM pre-training with spectral structure analysis
Researchers have developed Pro-KLShampoo, an optimization technique that combines gradient preconditioning with orthogonalization for more efficient LLM pre-training. This method leverages the observed spike-and-flat ei…