Researchers have developed S1-Evo, a novel framework designed to attack and manipulate Typed System-1 (S1) decision models, which are increasingly used in LLM agents for tasks like routing and moderation. Unlike attacks targeting autoregressive models, S1-Evo focuses on S1's contract-based option competition and margin feedback. The framework perturbs untrusted fields to create "evidence competition" with original task evidence, aiming to alter the model's execution path. Tested across four benchmarks and three S1 models, S1-Evo achieved a mean attack success rate (ASR) of 71.99% and a high-confidence ASR of 57.47% on the JEV-1.14 benchmark, leading to up to 24.00% end-to-end agent violations. AI
IMPACT Introduces a new attack vector for System-1 decision models used in LLM agents, potentially impacting their security and reliability.
RANK_REASON Academic paper detailing a new attack framework on AI models. [lever_c_demoted from research: ic=1 ai=1.0]
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →
