PulseAugur
EN
LIVE 08:51:59

New MissClick attack exploits GUI grounding models via coordinate manipulation

By PulseAugur Editorial · [1 sources] ·

Researchers have developed a new adversarial attack called MissClick that targets GUI grounding models by exploiting how they parse screen coordinates. The attack manipulates digit-serialized coordinates, causing large displacements in the executed clicks. MissClick offers two objectives: MissClick-U for untargeted disruption and MissClick-T for targeted hijacking of clicks. Experiments show MissClick significantly outperforms existing attacks on desktop, web, and mobile platforms. AI

IMPACT This research highlights a new vulnerability in GUI grounding models, potentially impacting the security of AI-driven interfaces.

RANK_REASON The cluster contains a research paper detailing a novel adversarial attack on AI models. [lever_c_demoted from research: ic=1 ai=1.0]

Read on arXiv cs.AI →

AI-generated summary · Google Gemini · from 1 sources. How we write summaries →

New MissClick attack exploits GUI grounding models via coordinate manipulation

COVERAGE [1]

  1. arXiv cs.AI TIER_1 English(EN) · Yu Ran, Wentao Zhao, Xin Zhang, Yi Pan ·

    MissClick: Exploiting Digit-Serialized Coordinates to Attack GUI Grounding Models

    arXiv:2608.03740v1 Announce Type: new Abstract: Recent GUI visual grounding models generate screen coordinates as sequences of digit tokens that are parsed into numerical values and mapped to executable clicks. The security implications of this coordinate generation process have …

RELATED TOPICS