PulseAugur
实时 14:35:46

新的AI遗忘方法在数据移除和模型效用之间取得平衡

研究人员开发了新的机器学习遗忘方法,该方法可以在不完全重新训练的情况下从AI模型中移除特定数据。一种名为SHRED的方法,利用自蒸馏和Logit降级来识别和移除遗忘集中的高信息量Token,在遗忘效果和模型效用之间实现了新的帕累托最优权衡。另一种方法,保留-正交代理遗忘(ROSU),通过最大化遗忘增益同时最小化对保留目标的影响来约束遗忘过程,以保留非目标知识。对于多模态大型语言模型,一种零空间约束的对比视觉遗忘技术将目标视觉知识与保留知识分开,从而减轻了性能下降。 AI

影响 机器学习遗忘领域的这些进展可以实现更高效、更精确地从AI模型中移除数据,这对于隐私和合规至关重要。

排序理由 多篇研究论文介绍了新颖的机器学习遗忘方法。

在 arXiv cs.LG 阅读 →

AI 生成摘要 · Google Gemini · 来自 4 个来源。 我们如何撰写摘要 →

新的AI遗忘方法在数据移除和模型效用之间取得平衡

报道来源 [4]

  1. arXiv cs.LG TIER_1 English(EN) · Robin Jia ·

    SHRED:通过带logit降级的自蒸馏实现保留集自由的遗忘

    Machine unlearning for large language models (LLMs) aims to selectively remove memorized content such as private data, copyrighted text, or hazardous knowledge, without costly full retraining. Most existing methods require a retain set of curated examples to prevent catastrophic …

  2. arXiv cs.LG TIER_1 English(EN) · Junhao Cai, Dohun Kim, Dowon Kim, Sung Il Choi, Chengjun Jin, Juhyun Park, Changhee Joo ·

    Retain-Neutral Surrogates for Min-Max Unlearning

    arXiv:2605.05871v1 Announce Type: new Abstract: Machine unlearning seeks to remove the influence of designated training data while preserving performance on the remaining data. Approximate unlearning can be viewed as a local editing problem; in min-max unlearning, the key local o…

  3. arXiv cs.AI TIER_1 English(EN) · Yuhang Wang, Zhenxing Niu, Haoxuan Ji, Guangyu He, Linlin Zhang, Haichang Gao ·

    MLLM 遗忘的空域约束对比视觉遗忘

    arXiv:2605.05909v1 Announce Type: new Abstract: The core challenge of machine unlearning is to strike a balance between target knowledge removal and non-target knowledge retention. In the context of Multimodal Large Language Models (MLLMs), this challenge becomes even more pronou…

  4. arXiv cs.CV TIER_1 English(EN) · Hongsin Lee, Hye Won Chung ·

    Sample-wise Adaptive Weighting for Transfer Consistency in Adversarial Distillation

    arXiv:2512.10275v2 Announce Type: replace Abstract: Adversarial distillation in the standard min-max adversarial training framework aims to transfer adversarial robustness from a large, robust teacher network to a compact student. However, existing work often neglects to incorpor…