PulseAugur
EN
LIVE 18:10:11

New research refines evaluation of AI model privacy attacks

Researchers are developing new frameworks and methods to evaluate the effectiveness and reliability of membership inference attacks (MIAs), which are used to detect if specific data was used in training machine learning models. Several recent papers propose novel approaches, including a full-pipeline framework that considers data, architectures, and algorithms, and methods that analyze MIAs from a frequency-domain perspective for diffusion models. Other research focuses on improving the efficiency and accuracy of vulnerability evaluation, addressing issues like calibration across samples and finite population bias, and developing techniques to assess per-sample vulnerability without costly retraining. AI

IMPACT Advances in MIA evaluation could lead to more robust privacy auditing for AI models, influencing how data is protected and models are deployed.

RANK_REASON Multiple academic papers published on arXiv detailing new research methodologies for evaluating AI privacy.

Read on arXiv cs.LG →

AI-generated summary · Google Gemini · from 6 sources. How we write summaries →

COVERAGE [6]

  1. arXiv cs.LG TIER_1 English(EN) · Ding Chen, Xinwen Cheng, Xuyang Zhong, Xinping Chen, Xiaolin Huang, Chen Liu ·

    A Full-Pipeline Framework for Evaluating Membership Inference Attacks in Machine Learning

    arXiv:2605.29454v1 Announce Type: new Abstract: While Membership Inference Attacks (MIAs) are the prevailing method for identifying training data, their application has expanded into privacy auditing and machine unlearning. Nevertheless, the field lacks a systematic framework for…

  2. arXiv cs.LG TIER_1 English(EN) · Puwei Lian, Yujun Cai, Songze Li, Bingkun Bao ·

    Enhancing Membership Inference Attacks on Diffusion Models from a Frequency-Domain Perspective

    arXiv:2505.20955v4 Announce Type: replace-cross Abstract: Diffusion models have achieved tremendous success in image generation, but they also raise significant concerns regarding privacy and copyright issues. Membership Inference Attacks (MIAs) are designed to ascertain whether …

  3. arXiv cs.LG TIER_1 English(EN) · Joonas J\"alk\"o, Gauri Pradhan, Ossi R\"ais\"a, Antti Honkela ·

    On Reliability of Efficient Membership Inference Vulnerability Evaluation

    arXiv:2605.25819v1 Announce Type: new Abstract: Membership inference attacks (MIAs) are popular methods for empirically assessing the leakage of sensitive information in the training data through models or statistics learned from the data. The MIA vulnerability is often evaluated…

  4. arXiv cs.LG TIER_1 English(EN) · Antti Honkela ·

    On Reliability of Efficient Membership Inference Vulnerability Evaluation

    Membership inference attacks (MIAs) are popular methods for empirically assessing the leakage of sensitive information in the training data through models or statistics learned from the data. The MIA vulnerability is often evaluated through false positive rate (FPR) and true posi…

  5. arXiv stat.ML TIER_1 English(EN) · Mathieu Even, Cl\'ement Berenfeld, Linus Bleistein, Tudor Cebere, Julie Josse, Aur\'elien Bellet ·

    Causal Evaluation of Membership Inference Attacks

    arXiv:2602.02819v3 Announce Type: replace-cross Abstract: Membership Inference Attacks (MIAs) aim to distinguish training points (members) from unseen data (non-members), and are widely used to quantify memorization and assess privacy risks. Standard MIA evaluation requires repea…

  6. arXiv stat.ML TIER_1 English(EN) · Valentin Dorseuil (DI-ENS), Jamal Atif (CMAP), Olivier Capp\'e (DI-ENS) ·

    Assessing Per-Sample Membership Inference Vulnerability without Retraining

    arXiv:2602.15919v2 Announce Type: replace Abstract: Recent work in the privacy literature shows that sample-targeted membership inference attacks (MIAs) significantly outperform untargeted approaches by a wide margin. Motivated by this observation, we address the following questi…