New attack hijacks LLM auto-optimization by preserving semantics

Researchers have developed a new black-box adversarial attack method called Adaptive Greedy Local Search, designed to hijack the auto-suggestion optimization modules within large language models. This technique works by subtly altering user input to cause semantic shifts in the model's output while maintaining a high degree of semantic similarity to the original text. Experiments on various LLMs indicate that this method is more successful than existing approaches in achieving its attack goals under similar semantic constraints. AI

IMPACT Highlights a vulnerability in LLM auto-optimization features, potentially impacting model security and trustworthiness.

RANK_REASON Academic paper detailing a new adversarial attack method on LLMs. [lever_c_demoted from research: ic=1 ai=1.0]

Read on arXiv cs.CL →

• Adaptive Greedy Local Search
• alphaXiv
• arXiv
• CatalyzeX
• Chong Zhang
• DagsHub
• Gotit.pub
• Hugging Face
• ScienceCast

• paper
• safety

AI-generated summary · Google Gemini · from 1 sources. How we write summaries →