TCAP: Tri-Component Attention Profiling for Unsupervised Backdoor Detection in MLLM Fine-Tuning
Researchers have developed a new unsupervised method called Tri-Component Attention Profiling (TCAP) to detect backdoors in fine-tuned Multimodal Large Language Models (MLLMs). This technique identifies poisoned data by analyzing how attention is distributed across system instructions, vision inputs, and user queries, noting that backdoor attacks disrupt this balance. TCAP uses statistical profiling and EM-based aggregation to isolate malicious samples, demonstrating robust performance across various MLLM architectures and attack types. AI
IMPACT Introduces a novel unsupervised defense against backdoor attacks in MLLMs, enhancing model security for fine-tuning services.