ENTITY
Maximal Update Parametrization
Maximal Update Parametrization
PulseAugur coverage of Maximal Update Parametrization — every cluster mentioning Maximal Update Parametrization across labs, papers, and developer communities, ranked by signal.
Total · 30d
2
2 over 90d
Releases · 30d
0
0 over 90d
Papers · 30d
2
2 over 90d
TIER MIX · 90D
TOPICS
RECENT · PAGE 1/1 · 2 TOTAL
-
Gated Delta Networks scaling rules improve LLM training stability
Researchers have developed new scaling rules for Gated Delta Networks, a type of neural network architecture. These rules, derived through a method called coordinate-size estimation propagation, allow for stable learnin…
-
Probabilistic Transformer scales to 0.4B parameters, outperforming standard models
Researchers have developed a method to scale Probabilistic Transformers (PTs) by transferring hyperparameters from smaller models to larger ones using Maximal Update Parametrization (muP). This technique addresses PT's …