English(EN) A Contradiction Judge Counted Reported Teammate Errors as Hallucinations: An Assertion-Aware Re-Score of One Multi-Agent LLM Harness

研究发现LLM裁判将队友错误误判为幻觉

作者 PulseAugur 编辑部 · [1 个来源] · 2026-11-14 05:00

最近发表在arXiv上的一项研究重新审视了LLM裁判如何评估多智能体系统中的幻觉问题。研究发现，这些裁判可能会错误地将队友错误报告标记为幻觉。这项基于固定计划的修订分析重新评分了先前研究的输出，并发现考虑断言事实时，幻觉率的影响微乎其微。然而，在判断提及内容时，幻觉得分显著增加。 AI

影响突出了LLM评估指标中潜在的缺陷，影响了多智能体系统的可靠性评估方式。

排序理由该集群包含一篇发表在arXiv上的研究论文，详细介绍了LLM行为的发现。[lever_c_demoted from research: ic=1 ai=1.0]

AI 生成摘要 · Google Gemini · 来自 1 个来源。我们如何撰写摘要 →

本文如何被排名

Signal score: 16 / 100; Composite score across the factors below. Higher = stronger signal that this story matters right now.
Newsworthiness bucket: Tool; 该集群包含一篇发表在arXiv上的研究论文，详细介绍了LLM行为的发现。[lever_c_demoted from research: ic=1 ai=1.0]
Source corroboration: Single-source cluster; Only one publisher covered this so far. Single-source stories can still rank when the publisher is high-authority, but they lack cross-source corroboration.
Topics: paper, safety; Editorial topic classification. Feeds into how the story surfaces on /topic/<slug> hub pages and into the per-entity coverage mix.
AI-industry relevance: High; Clearly on-topic for AI-industry coverage.
Story freshness: Breaking (< 6h); Fresh story with cross-source coverage still developing. Ranking may shift as more sources report.

完整方法见我们的编辑标准。

arXiv cs.AI TIER_1 English(EN) · Carson Rodrigues · 2026-11-14 05:00

一名裁判将报告的队友错误计为幻觉：对一个多智能体LLM基准的感知断言的重新评分

arXiv:2606.21666v2 Announce Type: replace Abstract: LLM judges that score hallucination flag any statement that contradicts a reference fact. Agents in multi-agent LLM systems quote and dispute each other's claims, so such a judge can count a correct report of a teammate's error …