generalized SGD

New optimization theory unifies DNN convexity and smoothness

Researchers have introduced a novel optimization framework for deep neural networks (DNNs) that generalizes classical convexity and smoothness concepts. This new framework, termed $\mathcal{H}(\psi)$-convexity and $\mat…