English(EN) The Backdrop Exposes What the World Around an Agent Costs It

新的BACKDROP基准揭示AI代理在动态环境中挣扎

作者 PulseAugur 编辑部 · [1 个来源] · 2026-10-01 04:00

一个名为BACKDROP的新基准被引入，用于评估AI代理在动态、真实世界环境中的表现，这与静态基准有显著不同。BACKDROP通过引入四种常见危险：权限、注入、边界和故障来测试代理，以评估当暴露于日常干扰时其性能如何下降。在3,678个变体和16个模型中，当所有危险都存在时，平均通过率从69.5%下降到31.3%，这表明清洁世界性能与真实世界能力之间存在巨大差距。 AI

影响凸显了AI代理的关键漏洞，表明当前基准高估了真实世界性能，并促使开发更强大的代理。

排序理由该集群描述了一篇介绍用于评估AI代理的新颖基准的学术论文。[lever_c_demoted from research: ic=1 ai=1.0]

在 arXiv cs.AI 阅读 →

AI 生成摘要 · Google Gemini · 来自 1 个来源。我们如何撰写摘要 →

本文如何被排名

Signal score: 22 / 100; Composite score across the factors below. Higher = stronger signal that this story matters right now.
Newsworthiness bucket: Tool; 该集群描述了一篇介绍用于评估AI代理的新颖基准的学术论文。[lever_c_demoted from research: ic=1 ai=1.0]
Source corroboration: Single-source cluster; Only one publisher covered this so far. Single-source stories can still rank when the publisher is high-authority, but they lack cross-source corroboration.
Topics: paper, safety; Editorial topic classification. Feeds into how the story surfaces on /topic/<slug> hub pages and into the per-entity coverage mix.
AI-industry relevance: High; Clearly on-topic for AI-industry coverage.
Story freshness: Breaking (< 6h); Fresh story with cross-source coverage still developing. Ranking may shift as more sources report.

完整方法见我们的编辑标准。

报道来源 [1]

arXiv cs.AI TIER_1 English(EN) · Nusrat Jahan Lia, Shubhashis Roy Dipta · 2026-10-01 04:00

背景揭示了代理周围的世界对其造成的代价

arXiv:2609.38469v1 Announce Type: cross Abstract: Agent benchmarks test agents in worlds that stay still. Deployed agents work in worlds that other people also change. Someone texts the agent to send the money elsewhere or an order confirmation asks it to reply with a door code. …

本文如何被排名

报道来源 [1]

背景揭示了代理周围的世界对其造成的代价

相关实体

相关话题