hierarchical tilted empirical risk minimization

New optimization methods achieve optimal sample complexity for complex nested functions

This paper introduces novel momentum-based methods for stochastic multi-level optimization, where the objective function is a nested composition of several non-convex functions. The proposed techniques utilize mini-batc…