English(EN) Self-Reports Are Not Verification: Environment-Grounded Auditing of LLM Operators in Evolutionary Search

新研究质疑语言模型代理的自我报告，发现其不可靠

作者 PulseAugur 编辑部 · [1 个来源] · 2026-09-02 04:00

一篇题为《自我报告并非验证：进化搜索中语言模型操作员的环境基础审计》的新研究论文发表在arXiv上，该论文质疑语言模型代理的自我报告的置信度和合理性。这项研究在进化搜索环境中审计了语言模型操作员，发现这些代理持续夸大其成功率，报告的置信度未得到校准，继承的合理性对后续提议影响甚微。此外，研究表明，基于适应度或随机选择的方法均未能提高自我报告的准确性，这表明代理的自我报告应被视为需要外部验证的声明，而不是其自身可信度的证据。 AI

影响强调了对语言模型代理输出进行稳健外部验证机制的必要性，影响了对其可靠性的评估方式。

排序理由发表在arXiv上的学术论文，详细介绍了研究结果。[lever_c_demoted from research: ic=1 ai=1.0]

在 arXiv cs.AI 阅读 →

AI 生成摘要 · Google Gemini · 来自 1 个来源。我们如何撰写摘要 →

本文如何被排名

Signal score: 32 / 100; Composite score across the factors below. Higher = stronger signal that this story matters right now.
Newsworthiness bucket: Tool; 发表在arXiv上的学术论文，详细介绍了研究结果。[lever_c_demoted from research: ic=1 ai=1.0]
Source corroboration: Single-source cluster; Only one publisher covered this so far. Single-source stories can still rank when the publisher is high-authority, but they lack cross-source corroboration.
Topics: paper, safety; Editorial topic classification. Feeds into how the story surfaces on /topic/<slug> hub pages and into the per-entity coverage mix.
AI-industry relevance: High; Clearly on-topic for AI-industry coverage.
Story freshness: Breaking (< 6h); Fresh story with cross-source coverage still developing. Ranking may shift as more sources report.

完整方法见我们的编辑标准。

报道来源 [1]

arXiv cs.AI TIER_1 English(EN) · Enrong Pan, Ryan Zhou, Ting Hu · 2026-09-02 04:00

自我报告并非验证：进化搜索中基于环境的LLM操作员审计

arXiv:2609.00652v1 Announce Type: new Abstract: Language model agents increasingly propose actions, observe external feedback, and explain their own behavior. Their confidence and rationales are convenient monitoring signals, but convenience is not verification. We introduce an e…

本文如何被排名

报道来源 [1]

自我报告并非验证：进化搜索中基于环境的LLM操作员审计

相关实体

相关话题