English(EN) STALE: Can LLM Agents Know When Their Memories Are No Longer Valid?

新的STALE基准揭示大型语言模型代理难以处理过时的记忆

作者 PulseAugur 编辑部 · [2 个来源] · 2026-05-07 16:31

研究人员推出了STALE，这是一个旨在评估大型语言模型代理识别其存储记忆何时过时能力的基准。该基准包含跨越100多个主题的400个冲突场景，测试状态解析、前提抵抗和隐式策略适应能力。评估显示，即使是表现最好的大型语言模型也难以掌握这项能力，准确率仅为55.2%，表明代理记忆系统存在重大差距。 AI

影响突出了大型语言模型代理记忆中的一个关键差距，表明未来需要进行更多工作来构建更强大、更可靠的人工智能系统。

排序理由该集群包含一篇介绍大型语言模型代理新基准和评估的学术论文。

AI 生成摘要 · Google Gemini · 来自 2 个来源。我们如何撰写摘要 →

本文如何被排名

Signal score: 0 / 100; Composite score across the factors below. Higher = stronger signal that this story matters right now.
Newsworthiness bucket: Research; 该集群包含一篇介绍大型语言模型代理新基准和评估的学术论文。
Source corroboration: 2 independent sources; Multiple independent publishers reporting the same story raises confidence that it's real and newsworthy.
Topics: paper, other; Editorial topic classification. Feeds into how the story surfaces on /topic/<slug> hub pages and into the per-entity coverage mix.
AI-industry relevance: High; Clearly on-topic for AI-industry coverage.
Story freshness: 160 days old; Aged out of breaking-news scoring windows; ranking reflects the durable signal from the full source set.

完整方法见我们的编辑标准。

arXiv cs.CL TIER_1 English(EN) · Hanxiang Chao, Yihan Bai, Rui Sheng, Tianle Li, Yushi Sun · 2026-05-08 04:00

STALE：大型语言模型代理何时知道其记忆不再有效？

arXiv:2605.06527v1 Announce Type: new Abstract: Large Language Model (LLM) agents are increasingly expected to maintain coherent, long-term personalized memory, yet current benchmarks primarily measure static fact retrieval, overlooking the ability to revise stored beliefs when n…
arXiv cs.CL TIER_1 English(EN) · Yushi Sun · 2026-05-07 16:31

STALE：大型语言模型代理何时知道其记忆不再有效？

Large Language Model (LLM) agents are increasingly expected to maintain coherent, long-term personalized memory, yet current benchmarks primarily measure static fact retrieval, overlooking the ability to revise stored beliefs when new evidence emerges. We identify a critical and …