Konstantinos Spiliopoulos

Newton's method converges faster for overparameterized neural networks

Researchers have developed a convergence analysis for Newton's method applied to neural networks in an overparameterized setting. Their work shows that as the number of hidden units increases, the training dynamics appr…