研究人员推出了两个新的基准测试，SovereignPA-Bench和SovereignNegotiation-Bench，旨在评估个人AI代理。这些基准测试侧重于评估代理维护用户主权的能力，包括尊重隐私、同意和证据，同时也要推进用户的利益。评估超越了简单的任务完成，考察代理如何处理不断变化的用户意图、平台中介以及潜在的操纵性激励，特别是在协商场景中。 AI
影响 这些基准测试可能会推动更值得信赖且与用户保持一致的个人AI代理的开发。
排序理由 该集群包含两篇介绍用于评估AI代理的新基准测试的学术论文。
AI 生成摘要 · Google Gemini · 来自 4 个来源。 我们如何撰写摘要 →
arXiv:2607.05363v1 Announce Type: new Abstract: Personal agents are becoming persistent user-owned intermediaries: they remember preferences, filter platform-mediated information, use tools, and negotiate with services. Existing benchmarks evaluate tool use, web navigation, deskt…
arXiv:2607.02814v1 Announce Type: cross Abstract: Personal agents will increasingly negotiate on behalf of users: splitting costs with other personal agents, appealing platform decisions, escalating support disputes, requesting refunds, changing subscriptions, and negotiating dea…
Personal agents are becoming persistent user-owned intermediaries: they remember preferences, filter platform-mediated information, use tools, and negotiate with services. Existing benchmarks evaluate tool use, web navigation, desktop control, personalization, recommendation, and…
Personal agents will increasingly negotiate on behalf of users: splitting costs with other personal agents, appealing platform decisions, escalating support disputes, requesting refunds, changing subscriptions, and negotiating deadlines or reimbursements. Existing negotiation ben…