PulseAugur
中
实时 21:09:45
English(EN) Strong Gaussian Approximation of Constant-Learning-Rate SGD: Bias and Trajectory Inference

新论文为SGD提供强高斯近似

作者 PulseAugur 编辑部 · [1 个来源] ·

本文为常数学习率随机梯度下降（SGD）引入了强高斯近似，特别适用于重尾噪声以及迭代次数增加而学习率缩小时的情况。该研究开发了简单的过程高斯模型，并界定了SGD误差与其极限之间的差异，从而实现了有限样本、整个轨迹的推断。研究结果揭示了控制SGD偏差和初始化效应之间的权衡，建议采用预热方案或Richardson-Romberg外推法来消除这些贡献并实现随机过程收敛。 AI

影响 在理解随机梯度下降行为方面提供了理论进展，可能导致更鲁棒的机器学习优化技术。

排序理由 关于机器学习统计方法的学术论文。[lever_c_demoted from research: ic=1 ai=1.0]

在 arXiv stat.ML 阅读 →

AI 生成摘要 · Google Gemini · 来自 1 个来源。 我们如何撰写摘要 →

新论文为SGD提供强高斯近似

本文如何被排名

Signal score
3 / 100
Composite score across the factors below. Higher = stronger signal that this story matters right now.
Newsworthiness bucket
Tool
关于机器学习统计方法的学术论文。[lever_c_demoted from research: ic=1 ai=1.0]
Source corroboration
Single-source cluster
Only one publisher covered this so far. Single-source stories can still rank when the publisher is high-authority, but they lack cross-source corroboration.
Topics
paper, other
Editorial topic classification. Feeds into how the story surfaces on /topic/<slug> hub pages and into the per-entity coverage mix.
AI-industry relevance
High
Clearly on-topic for AI-industry coverage.
Story freshness
Same-day
Cluster formed today. Ranking reflects the current source set at time of score.

完整方法见我们的编辑标准。

报道来源 [1]

  1. arXiv stat.ML TIER_1 English(EN) · Joseph Keslin, Wei Biao Wu ·

    常数学习率SGD的强高斯近似：偏差与轨迹推断

    arXiv:2610.14567v1 Announce Type: new Abstract: This paper develops strong Gaussian approximations (KMT type) for constant learning rate stochastic gradient descent (SGD). We work with heavy tailed noise and assume that the number of iterates grows and the learning rate shrinks s…

相关实体

相关话题