PulseAugur
EN
LIVE 10:32:48

New EVA framework evolves semantic attacks on GUI agents

Researchers have developed EVA, an evolutionary framework designed to identify semantic vulnerabilities in GUI agents powered by multimodal large language models (MLLMs). This method focuses on manipulating the semantic understanding of agents rather than their visual perception, achieving up to an 85% success rate in attacks. EVA rapidly evolves adversarial payloads within the model's latent space, highlighting a paradox where alignment training can make agents more susceptible to deceptive semantic cues. AI

IMPACT Reveals a critical alignment paradox where agents trained for instruction-following are vulnerable to semantic deception, potentially impacting future AI safety research.

RANK_REASON The cluster contains an academic paper detailing a new method for red-teaming AI agents. [lever_c_demoted from research: ic=1 ai=1.0]

Read on arXiv cs.AI →

AI-generated summary · Google Gemini · from 1 sources. How we write summaries →

COVERAGE [1]

  1. arXiv cs.AI TIER_1 English(EN) · Yijie Lu, Manman Zhao, Tianjie Ju, Zihe Yan, Xinbei Ma, Yuan Guo, Daizong Ding, Gongshen Liu, Zhuosheng Zhang ·

    EVA: Evolving Semantic Adversaries for Red-Teaming GUI Agents Against Environmental Injection Attacks

    arXiv:2505.14289v2 Announce Type: replace Abstract: Graphical User Interface (GUI) agents powered by Multimodal Large Language Models (MLLMs) are increasingly deployed yet vulnerable to Environmental Injection Attacks (EIAs).However, current red-teaming methods are hindered by pr…