Israel Mason-Williams

New research questions flat minima as universal proxy for generalization

A new paper challenges the long-held belief that flat minima in deep neural networks universally lead to better generalization. Researchers argue that flatness is a function-dependent property and that sharpness can som…