PulseAugur
EN
LIVE 07:16:37

Statistically undetectable backdoors planted in deep neural networks

Researchers have demonstrated a method for embedding statistically undetectable backdoors into deep neural networks. These backdoors are designed to be imperceptible even with full model access, meaning the backdoored model is nearly identical to an honestly trained one in terms of total variation distance. The backdoor enables the generation of invariance-based adversarial examples, which are otherwise provably impossible to create in polynomial time without the backdoor. This work highlights a significant power imbalance between those who train models and those who use them. AI

IMPACT Reveals a fundamental security vulnerability in deep learning models, potentially impacting trust and security in AI systems.

RANK_REASON Academic paper detailing a new security vulnerability in machine learning models. [lever_c_demoted from research: ic=1 ai=1.0]

Read on arXiv stat.ML →

AI-generated summary · Google Gemini · from 1 sources. How we write summaries →

Statistically undetectable backdoors planted in deep neural networks

COVERAGE [1]

  1. arXiv stat.ML TIER_1 English(EN) · Neekon Vafa ·

    Statistically Undetectable Backdoors in Deep Neural Networks

    We show how an adversarial model trainer can plant backdoors in a large class of deep, feedforward neural networks. These backdoors are statistically undetectable in the white-box setting, meaning that the backdoored and honestly trained models are close in total variation distan…