English(EN) ReFract: Benchmarking Perspective Awareness in Language Model Agents with Text World Models

新的ReFract基准测试语言模型代理的视角感知能力

作者 PulseAugur 编辑部 · [1 个来源] · 2026-10-05 04:00

研究人员推出了ReFract，这是一个旨在评估语言模型代理“视角感知”能力的新基准。该基准包含150个经过专家验证的条目，用于评估代理根据用户角色、知识和能力定制其行为和信息的能力。目前最先进的LLM在这方面存在困难，经常尝试违反用户视角的行为，这凸显了在代理评估方面存在重大差距。 AI

影响强调了AI代理开发中一个关键且尚未解决的方面，可能指导未来研究朝着更具角色意识和更安全的AI交互方向发展。

排序理由该集群包含一篇介绍用于评估AI代理的新基准的学术论文。[lever_c_demoted from research: ic=1 ai=1.0]

AI 生成摘要 · Google Gemini · 来自 1 个来源。我们如何撰写摘要 →

本文如何被排名

Signal score: 11 / 100; Composite score across the factors below. Higher = stronger signal that this story matters right now.
Newsworthiness bucket: Tool; 该集群包含一篇介绍用于评估AI代理的新基准的学术论文。[lever_c_demoted from research: ic=1 ai=1.0]
Source corroboration: Single-source cluster; Only one publisher covered this so far. Single-source stories can still rank when the publisher is high-authority, but they lack cross-source corroboration.
Topics: paper, product; Editorial topic classification. Feeds into how the story surfaces on /topic/<slug> hub pages and into the per-entity coverage mix.
AI-industry relevance: High; Clearly on-topic for AI-industry coverage.
Story freshness: Same-day; Cluster formed today. Ranking reflects the current source set at time of score.

完整方法见我们的编辑标准。

arXiv cs.AI TIER_1 English(EN) · Hainiu Xu, V\'{i}tor N. Louren\c{c}o, Mohnish Dubey, Yunfei Bai, Yulan He, Caroline Catmur, Aline Paes, Marco Caserta, Akash Chandrayan, Luca D'Angelo · 2026-10-05 04:00

ReFract：使用文本世界模型对语言模型代理中的视角感知进行基准测试

arXiv:2610.03356v1 Announce Type: new Abstract: Large Language Model (LLM) agents are increasingly deployed in high-stakes settings such as industrial maintenance and equipment fault troubleshooting, where workers occupy a variety of roles. A capable agent must therefore act in a…