English(EN) Big-Big-SycoBench: A Benchmark to Detect Sycophancy Through Model Responses to Valid vs. Invalid Arguments

新基准通过论点辨别能力衡量大型语言模型的谄媚行为

作者 PulseAugur 编辑部 · [1 个来源] · 2026-10-15 04:00

研究人员推出了 Big-Big-SycoBench，这是一个旨在评估大型语言模型（LLM）谄媚行为的新基准。该基准评估模型在面对有效批评时修正其判断的能力，同时抵制无效论点或谬误的压力。该基准包含 450 个文本制品和大量论点，经过人工标注员的审查，并已在十种不同的 LLM 上进行了测试。 AI

影响该基准可以推动开发更可靠、更不易受操纵且更擅长辨别有效论点的大型语言模型。

排序理由该集群包含一篇介绍用于评估大型语言模型行为的新基准的研究论文。[lever_c_demoted from research: ic=1 ai=1.0]

AI 生成摘要 · Google Gemini · 来自 1 个来源。我们如何撰写摘要 →

本文如何被排名

Signal score: 6 / 100; Composite score across the factors below. Higher = stronger signal that this story matters right now.
Newsworthiness bucket: Tool; 该集群包含一篇介绍用于评估大型语言模型行为的新基准的研究论文。[lever_c_demoted from research: ic=1 ai=1.0]
Source corroboration: Single-source cluster; Only one publisher covered this so far. Single-source stories can still rank when the publisher is high-authority, but they lack cross-source corroboration.
Topics: paper, safety; Editorial topic classification. Feeds into how the story surfaces on /topic/<slug> hub pages and into the per-entity coverage mix.
AI-industry relevance: High; Clearly on-topic for AI-industry coverage.
Story freshness: Same-day; Cluster formed today. Ranking reflects the current source set at time of score.

完整方法见我们的编辑标准。

arXiv cs.AI TIER_1 English(EN) · Marthe Ballon, Arne Vanhoyweghen, Seorin Kim, Francesca Carlon, Lynn Delcon, Melika Mobini, Vincent Holst, Lukas Van de Voorde, Tibo Vanleke, Mathieu Louis, Bert Verbruggen, Brecht F. Verbeken, Andres Algaba, Vincent Ginis · 2026-10-15 04:00

Big-Big-SycoBench：通过模型对有效与无效论点的响应来检测谄媚行为的基准测试

arXiv:2610.15634v1 Announce Type: new Abstract: Sycophancy in large language models risks amplifying unsupported claims or beliefs across the knowledge ecosystem as these systems increasingly contribute to research synthesis, evaluation, and decision-making. A reliable model shou…