Researchers have developed a new cross-modal prompt injection attack called CrossMPI that can manipulate the interpretation of both text and image inputs in large vision-language models (LVLMs) through image-only perturbations. This attack optimizes perturbations within the model's hidden state space, which has a larger parameter count than typical visual embedding spaces. CrossMPI employs strategies like layer selection to identify critical layers for multimodal integration and a distance-decremental budget assignment for image perturbations to enhance its effectiveness. AI
IMPACT This research highlights a new vulnerability in LVLMs, potentially impacting the security and reliability of multimodal AI systems.
RANK_REASON Academic paper detailing a novel attack method against AI models. [lever_c_demoted from research: ic=1 ai=1.0]
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →