Rodion Podorozhny

New blockwise optimizer enhances cubic Newton methods for large-scale neural networks

This paper introduces a novel blockwise optimizer designed to improve the efficiency of cubic regularized Newton methods for large-scale neural network training. The proposed method handles arbitrarily large parameter t…