English(EN) Verifiable Social Reasoning for LLM Assistants

新框架通过多智能体模拟评估LLM社交推理

作者 PulseAugur 编辑部 · [1 个来源] · 2026-09-16 04:00

研究人员开发了Fuse，一个新颖的多智能体模拟框架，旨在评估LLM助手的社交推理能力。该框架通过创建LLM必须根据主观用户叙述推断隐藏动机的场景来应对评估社交推理的挑战。一项包含大量注释的人类研究验证了模拟的准确性，随后将其应用于12个LLM，结果表明用户中介、有偏见的框架和提供的信息量对性能有显著影响，而更长的对话并不总是能带来更好的结果。 AI

影响提供了一种评估LLM社交推理的新方法，有可能提高其在咨询角色中的可靠性。

排序理由该条目描述了一篇关于评估LLM能力的新研究论文和框架。[lever_c_demoted from research: ic=1 ai=1.0]

在 arXiv cs.AI 阅读 →

AI 生成摘要 · Google Gemini · 来自 1 个来源。我们如何撰写摘要 →

本文如何被排名

Signal score: 14 / 100; Composite score across the factors below. Higher = stronger signal that this story matters right now.
Newsworthiness bucket: Tool; 该条目描述了一篇关于评估LLM能力的新研究论文和框架。[lever_c_demoted from research: ic=1 ai=1.0]
Source corroboration: Single-source cluster; Only one publisher covered this so far. Single-source stories can still rank when the publisher is high-authority, but they lack cross-source corroboration.
Topics: paper, safety; Editorial topic classification. Feeds into how the story surfaces on /topic/<slug> hub pages and into the per-entity coverage mix.
AI-industry relevance: High; Clearly on-topic for AI-industry coverage.
Story freshness: Breaking (< 6h); Fresh story with cross-source coverage still developing. Ranking may shift as more sources report.

完整方法见我们的编辑标准。

报道来源 [1]

arXiv cs.AI TIER_1 English(EN) · Amir Taubenfeld, Zorik Gekhman, Avigail Grinstein-Dabush, Itay Laish, Ariel Goldstein, Marian Croak, Avinatan Hassidim, Yossi Matias, Amir Feder · 2026-09-16 04:00

LLM助手可验证的社会推理

arXiv:2609.17496v1 Announce Type: new Abstract: LLM assistants are widely used for daily social advice, yet evaluating their social reasoning in such consultation settings remains challenging since (i) it requires setups where the assistant learns about social situations from sub…

本文如何被排名

报道来源 [1]

LLM助手可验证的社会推理

相关实体

相关话题