A new research paper published on arXiv explores the limitations of using flatness proxies for robustness certificates and training interventions in machine learning models. The study demonstrates that a common last-layer relative-flatness proxy can underestimate loss increases by over 210x and that softmax shifts can render the proxy unbounded. Experiments on CIFAR-10 showed that these interventions can lead to substantial, reversible suppression of generalization. AI
IMPACT Highlights potential flaws in common methods for assessing and improving model robustness, suggesting a need for more reliable techniques.
RANK_REASON Research paper published on arXiv detailing theoretical and empirical findings. [lever_c_demoted from research: ic=1 ai=1.0]
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →