新研究质疑路由熵作为人工智能模型中可靠不确定性信号的有效性

作者 PulseAugur 编辑部 · [1 个来源] · 2026-10-02 04:00

研究人员调查了注意力残差Transformer中的路由熵是否可以作为模型固有置信度之外的不确定性信号。他们对在CIFAR-10/100数据集上训练的Swin-Tiny和DeiT-Small模型进行了审计，发现与仅置信度预测器相比，路由迹线不能一致地预测正确性或提高校准。虽然一些证据表明相对于打乱的迹线有所提升，但这并未转化为比模型输出置信度更实用的优势。该研究建立了依赖于控制的增益和不完整的估计器恢复，表明虽然条件路由信息可能存在，但在这些配置中它不易被利用为可靠的不确定性度量。 AI

影响这项研究表明，目前解释Transformer中路由熵的方法可能无法可靠地指示模型的不确定性，这可能会影响置信分数在人工智能应用中的使用方式。

排序理由该集群包含一篇在arXiv上发表的研究论文，详细介绍了关于人工智能模型行为的实验结果。[lever_c_demoted from research: ic=1 ai=1.0]

在 arXiv cs.AI 阅读 →

AI 生成摘要 · Google Gemini · 来自 1 个来源。我们如何撰写摘要 →

本文如何被排名

Signal score: 13 / 100; Composite score across the factors below. Higher = stronger signal that this story matters right now.
Newsworthiness bucket: Tool; 该集群包含一篇在arXiv上发表的研究论文，详细介绍了关于人工智能模型行为的实验结果。[lever_c_demoted from research: ic=1 ai=1.0]
Source corroboration: Single-source cluster; Only one publisher covered this so far. Single-source stories can still rank when the publisher is high-authority, but they lack cross-source corroboration.
Topics: paper, model release; Editorial topic classification. Feeds into how the story surfaces on /topic/<slug> hub pages and into the per-entity coverage mix.
AI-industry relevance: High; Clearly on-topic for AI-industry coverage.
Story freshness: Breaking (< 6h); Fresh story with cross-source coverage still developing. Ranking may shift as more sources report.

完整方法见我们的编辑标准。

报道来源 [1]

arXiv cs.AI TIER_1 English(EN) · Wenhao Liang, Lin Yue, Wei Emma Zhang, Mingyu Guo, Olaf Maennel, Weitong Chen · 2026-10-02 04:00

Auditing Routing Entropy as an Uncertainty Signal in Attention-Residual Transformers

arXiv:2610.01495v1 Announce Type: new Abstract: Dynamic architectures leave a per-example routing trace beside each prediction, and diffuse routing is easy to read as a sign that the prediction is unreliable. We audit that reading for routing entropy in Attention-Residual (AR) va…

本文如何被排名

报道来源 [1]

Auditing Routing Entropy as an Uncertainty Signal in Attention-Residual Transformers

相关实体

相关话题