New backdoor attack exploits LLM dialogue structure

Researchers have developed a novel backdoor attack called Turn-based Structural Triggers (TST) that exploits the dialogue structure of Large Language Models (LLMs) rather than user-visible prompts. This attack uses the turn index within a conversation as the trigger, allowing a backdoored model to execute malicious behaviors at specific points in a dialogue without any discernible input trigger. TST demonstrated a high attack success rate across multiple LLM families while maintaining normal performance on non-triggered tasks, highlighting a new vulnerability in multi-turn conversational AI systems. AI

IMPACT Reveals a new attack vector for LLMs, necessitating the development of structure-aware auditing methods beyond prompt inspection.

RANK_REASON The cluster contains an academic paper detailing a new method for attacking LLMs. [lever_c_demoted from research: ic=1 ai=1.0]

Read on arXiv cs.LG →

• Large Language Models
• Turn-based Structural Triggers
• Yiyang Lu

• paper
• safety

AI-generated summary · Google Gemini · from 1 sources. How we write summaries →