Hannah Pinson

Researchers explore how gradient descent adapts neural network capacity to tasks

Researchers have developed a theoretical framework to explain how neural networks adapt their capacity to specific tasks during gradient descent training. The study identifies three key dynamical principles—mutual align…