PulseAugur
中
实时 05:55:34

新的BSAM技术找到更平坦的神经网络最小值

研究人员推出了一种名为双边锐度感知最小化(BSAM)的新型优化技术,旨在实现神经网络中更平坦的最小值。与主要关注梯度上升方向最大锐度现有方法不同,BSAM还考虑了邻域内的最小锐度。这种融合了最大锐度和最小锐度的双重方法旨在提供更鲁棒的平坦度指标,从而在分类、迁移学习和姿态估计等各种任务中提高泛化能力和鲁棒性。理论分析表明BSAM收敛到局部最小值,实验结果显示其优于标准的SAM。 AI

影响 引入了一种新的优化方法,可以提高神经网络的泛化能力和鲁棒性。

排序理由 该集群包含一篇学术论文,详细介绍了一种用于神经网络的新优化技术。[lever_c_demoted from research: ic=1 ai=1.0]

在 arXiv cs.LG 阅读 →

AI 生成摘要 · Google Gemini · 来自 1 个来源。 我们如何撰写摘要 →

新的BSAM技术找到更平坦的神经网络最小值

本文如何被排名

Signal score
1 / 100
Composite score across the factors below. Higher = stronger signal that this story matters right now.
Newsworthiness bucket
Tool
该集群包含一篇学术论文,详细介绍了一种用于神经网络的新优化技术。[lever_c_demoted from research: ic=1 ai=1.0]
Source corroboration
Single-source cluster
Only one publisher covered this so far. Single-source stories can still rank when the publisher is high-authority, but they lack cross-source corroboration.
Topics
paper, other
Editorial topic classification. Feeds into how the story surfaces on /topic/<slug> hub pages and into the per-entity coverage mix.
AI-industry relevance
High
Clearly on-topic for AI-industry coverage.
Story freshness
2 days old
Coverage has settled into its steady-state source set.

完整方法见我们的编辑标准。

报道来源 [1]

  1. arXiv cs.LG TIER_1 English(EN) · Jiaxin Deng, Junbiao Pang, Baochang Zhang, Qingming Huang ·

    用于更平坦极值的双边感知锐度最小化

    arXiv:2409.13173v2 Announce Type: replace-cross Abstract: Sharpness-Aware Minimization (SAM) enhances generalization by reducing a Max-Sharpness (MaxS). Despite the practical success, we empirically found that the MAxS behind SAM's generalization enhancements face the "Flatness I…