Edge of Stability
PulseAugur coverage of Edge of Stability — every cluster mentioning Edge of Stability across labs, papers, and developer communities, ranked by signal.
2 day(s) with sentiment data
-
Research paper reframes gradient descent as dynamical system
A new research paper explores finite-step gradient descent not as a simple optimization tool, but as a discrete dynamical system. The study analyzes how the training map's behavior, including phenomena like edge-of-stab…
-
New research frameworks model gradient descent at the edge of stability
Two new research papers explore the phenomenon of gradient descent operating at the edge of stability (EoS) in deep learning. The first paper introduces 'Edge Flow,' a system of differential equations that models gradie…
-
Research: Edge of Stability selectively shapes ML learning
A new research paper explores the "edge of stability" (EoS) in machine learning optimization, revealing it's not a uniform property but a selective one. The study demonstrates that EoS can redistribute learning across d…
-
Researchers pinpoint origin of neural network 'Edge of Stability' phenomenon
Researchers have introduced a new concept called the 'edge coupling' to explain the phenomenon known as the Edge of Stability in neural network training. This functional, applied to consecutive iterate pairs, helps to e…