Researchers have developed CarryoverBench, a new benchmark designed to evaluate the persistence of prompt injection attacks on LLM agents. These "carryover attacks" can re-fire across sessions long after the initial malicious input, exploiting agent memory files or scheduled tasks. The benchmark includes 12 personal-assistant scenarios and 101 attack tasks across three trigger channels: instant, autonomous, and latent. Testing on five frontier models revealed that planted payloads can re-fire over multiple rounds without significant decay, and runtime-layer controls may be necessary for effective defense. AI
IMPACT Highlights a critical security vulnerability in LLM agents, potentially impacting their safe deployment in persistent applications.
RANK_REASON The cluster contains a research paper detailing a new benchmark for evaluating a specific type of security vulnerability in LLM agents. [lever_c_demoted from research: ic=1 ai=1.0]
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →