Researchers have developed a new theoretical framework using evolutionary game theory to understand shortcut learning in deep neural networks. The study formally defines core and shortcut features, modeling data samples as players and neural tangent features as strategies. Findings indicate that gradient descent and stochastic gradient descent lead to different stable states, with gradient descent favoring shortcut optimization and stochastic gradient descent favoring core optimization. AI
影响 Provides a theoretical understanding of shortcut learning dynamics and potential mitigation strategies.
排序理由 This is a research paper published on arXiv detailing a theoretical analysis of shortcut learning.
AI 生成摘要 · Google Gemini · 来自 2 个来源。 我们如何撰写摘要 →
