Stieltjes

New research reveals divergence in ReLU neural network training dynamics

A new paper published on arXiv explores the mathematical underpinnings of training neural networks with ReLU activation functions. The research demonstrates that the gradient descent algorithm, when applied to these net…