AdaGrad-Norm
PulseAugur coverage of AdaGrad-Norm — every cluster mentioning AdaGrad-Norm across labs, papers, and developer communities, ranked by signal.
-
New optimization method adapts to unknown smoothness conditions
Researchers have developed a novel two-phase optimization method designed to improve convergence rates for stochastic non-convex optimization. This method adapts to different smoothness conditions (average, standard, an…
-
New parameter-free optimizer AdamG simplifies hyperparameter tuning
Researchers have developed a new parameter-free optimizer called AdamG, which aims to simplify hyperparameter tuning by automatically adapting to various optimization problems. This novel approach, based on a golden ste…
-
New OptMuon method enhances stochastic optimization with adaptive momentum
Researchers have introduced OptMuon, a novel adaptive momentum orthogonalization method for stochastic nonconvex optimization that calibrates update magnitudes from observed trajectories. This approach combines Muon-sty…