Layerwise LQR

Layerwise LQR framework optimizes deep networks using geometry-aware control

Researchers have developed Layerwise LQR (LLQR), a new optimization framework for deep learning models. LLQR reformulates second-order optimization methods, like Newton's method, as a linear quadratic regulator problem.…