macdonaldeos

Gradient Descent Theory Extended for Complex Minima and Vector Outputs

This paper extends the theory of gradient descent (GD) with large step sizes to more complex scenarios. It addresses overparameterized least-squares problems with vector-valued outputs and analyzes neighborhoods of mani…