English(EN) On the Dynamics of Delayed Generalization in Linear Models

研究发现线性模型中出现延迟泛化

作者 PulseAugur 编辑部 · [1 个来源] · 2026-10-15 04:00

研究人员已经证明，即使在简化的线性模型中，也可能出现延迟泛化现象，即训练精度显著超过测试精度。当在线性可分数据上使用具有指数尾部损失的梯度下降时，就会出现这种效应。该研究将该过程分为三个阶段：总体、支持向量主导的遗忘和泛化，其中残差超出最大间隔方向的收敛启动了遗忘阶段。通过实验验证了这些动力学，并在使用MNIST数据集的深度模型中观察到了这些动力学。 AI

影响为模型泛化动力学提供了理论见解，可能为未来的模型设计和训练策略提供信息。

排序理由阐述理论发现和实验验证的学术论文。[lever_c_demoted from research: ic=1 ai=1.0]

在 arXiv cs.AI 阅读 →

AI 生成摘要 · Google Gemini · 来自 1 个来源。我们如何撰写摘要 →

本文如何被排名

Signal score: 12 / 100; Composite score across the factors below. Higher = stronger signal that this story matters right now.
Newsworthiness bucket: Tool; 阐述理论发现和实验验证的学术论文。[lever_c_demoted from research: ic=1 ai=1.0]
Source corroboration: Single-source cluster; Only one publisher covered this so far. Single-source stories can still rank when the publisher is high-authority, but they lack cross-source corroboration.
Topics: paper, model release; Editorial topic classification. Feeds into how the story surfaces on /topic/<slug> hub pages and into the per-entity coverage mix.
AI-industry relevance: High; Clearly on-topic for AI-industry coverage.
Story freshness: Breaking (< 6h); Fresh story with cross-source coverage still developing. Ranking may shift as more sources report.

完整方法见我们的编辑标准。

报道来源 [1]

arXiv cs.AI TIER_1 English(EN) · Atreya Vedantam, Nataraj Das, Chandrashekar Lakshminarayanan · 2026-10-15 04:00

线性模型中延迟泛化的动力学研究

arXiv:2602.08302v3 Announce Type: replace-cross Abstract: Delayed generalization, where training accuracy becomes nearly perfect substantially before test accuracy, has often been studied in the context of the depth and compositional structure of deep networks. In this paper, we …

本文如何被排名

报道来源 [1]

线性模型中延迟泛化的动力学研究

相关实体

相关话题