Neural Legendre-Fenchel transform with Hessian Preconditioning
Researchers have developed a new method for approximating the Legendre-Fenchel transform, a key tool in convex analysis and machine learning. Their approach utilizes neural networks and introduces a Hessian-based preconditioning strategy to improve accuracy, especially for ill-conditioned functions. This method involves an affine deformation around a function's minimizer, simplifying the conjugation map and allowing a residual network to learn it more effectively. Experiments show enhanced convergence rates and numerical accuracy, particularly for challenging problems, with minimal computational overhead. AI
IMPACT Enhances numerical methods for optimization problems, potentially improving performance in machine learning tasks that rely on convex analysis.