Researchers have identified a security vulnerability in vision-language models (VLMs) and web agents, termed Scale-Induced Semantic Shift (SISS). This occurs when image transformations, such as resizing or compression, alter the machine-readable meaning of an image. An attack framework combining dual-scale verification and other techniques achieved a 58.75% success rate on a benchmark of four closed-source VLMs. The effectiveness of SISS is bounded by aggressive compression, with success rates dropping significantly at higher resolutions. While SISS can increase hidden instruction perception in web agents, it leads to only about a 4% absolute behavioral compromise. AI
IMPACT Highlights a novel attack vector against VLMs and web agents related to image preprocessing, necessitating scale-consistent inference.
RANK_REASON Academic paper detailing a new security vulnerability in VLMs. [lever_c_demoted from research: ic=1 ai=1.0]
- 128x128
- 224x224
- 336x336
- 512x512
- arXiv
- ScaleGuard
- Scale-Induced Semantic Shift
- Vision--Language Models
- Web agents
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →