Researchers have developed a new backdoor attack called Poison-then-Hide that can compromise pretrained vision encoders. This attack remains effective even when the entire model is finetuned on clean downstream data, a scenario where previous attacks often failed. Poison-then-Hide works by implanting a dormant backdoor in the base encoder, optimizing a trigger, and then using targeted unlearning to conceal the backdoor. The attack achieved up to 97% success rates on six datasets and three model architectures, highlighting the vulnerability of models to such sophisticated attacks, as standard defenses were unable to fully remove the backdoor. AI
IMPACT This research highlights a significant vulnerability in finetuning processes for vision encoders, potentially impacting the security of deployed AI systems.
RANK_REASON The cluster describes a novel academic research paper detailing a new type of attack on machine learning models. [lever_c_demoted from research: ic=1 ai=1.0]
Read on Hugging Face Daily Papers →
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →