PulseAugur
中
实时 09:18:22

SGD 动力学被建模为渗透过程,并扩展到 Adam 和 AdamW

研究人员将随机梯度下降 (SGD) 的动力学建模为渗透过程,揭示了架构对称性如何导致子网络以离散块的形式合并。这些转变会导致方差激增,类似于物理相变。该研究进一步证明,当 Adam 和 AdamW 等优化算法受到重尾噪声影响时,这种捕获机制及其尺度级联也适用于它们。 AI

影响 为理解深度学习中的优化提供了新的理论框架,可能导致更有效的训练方法。

排序理由 该集群包含一篇学术论文,详细介绍了机器学习中优化动力学的新建模方法。

在 Hugging Face Daily Papers 阅读 →

AI 生成摘要 · Google Gemini · 来自 2 个来源。 我们如何撰写摘要 →

SGD 动力学被建模为渗透过程,并扩展到 Adam 和 AdamW

本文如何被排名

Signal score
0 / 100
Composite score across the factors below. Higher = stronger signal that this story matters right now.
Newsworthiness bucket
Research
该集群包含一篇学术论文,详细介绍了机器学习中优化动力学的新建模方法。
Source corroboration
2 independent sources
Multiple independent publishers reporting the same story raises confidence that it's real and newsworthy.
Topics
paper, other
Editorial topic classification. Feeds into how the story surfaces on /topic/<slug> hub pages and into the per-entity coverage mix.
AI-industry relevance
High
Clearly on-topic for AI-industry coverage.
Story freshness
78 days old
Aged out of breaking-news scoring windows; ranking reflects the durable signal from the full source set.

完整方法见我们的编辑标准。

报道来源 [2]

  1. arXiv cs.AI TIER_1 English(EN) · Sai Niranjan Ramachandran, Suvrit Sra ·

    优化中的渗流动力学:方差级联与离散尺度不变性

    arXiv:2609.02373v1 Announce Type: cross Abstract: We study the dynamics of Stochastic Gradient Descent (SGD), which is known to steer deep neural networks toward invariant sets that correspond to simpler subnetworks. How this steering unfolds over time remains poorly understood. …

  2. Hugging Face Daily Papers TIER_1 English(EN) ·

    优化中的渗流动力学:方差级联与离散尺度不变性

    Stochastic gradient descent dynamics are modeled as a percolation process where architectural symmetries cause subnetworks to merge in discrete blocks, producing variance spikes resembling phase transitions, with similar trapping behavior extending to Adam and AdamW under heavy-t…