PulseAugur
实时 10:16:18
English(EN) Gradient-Free Continual Learning

新方法解决AI模型灾难性遗忘问题 · 跟踪3个来源

研究人员正在开发新方法,使大型语言模型能够顺序学习而不会忘记之前的任务。一种方法Latent-LoRA使用高斯混合模型和奇异值分解来有效地选择和更新特定任务的适配器。另一种方法EvoCL采用进化算法和轻量级适配器来实现无梯度持续学习,当无法存储旧数据时特别有用。第三个框架Mamba-CL通过更新与先前任务特征正交的参数来调整Mamba状态空间模型,理论上可以保持一致性并防止灾难性遗忘。 AI

影响 这些进展可以使AI系统能够随着时间的推移进行学习和适应,而不会丢失先前获得的知识,这对于长期部署至关重要。

排序理由 该集群包含三篇学术论文,详细介绍了AI模型持续学习的新颖方法。

在 arXiv cs.LG 阅读 →

AI 生成摘要 · Google Gemini · 来自 3 个来源。 我们如何撰写摘要 →

新方法解决AI模型灾难性遗忘问题 · 跟踪3个来源

报道来源 [3]

  1. arXiv cs.CL TIER_1 English(EN) · Reza Rahimi Azghan, Gautham Krishna Gudur, Giulia Pedrielli, Pavan Turaga, Hassan Ghasemzadeh ·

    Latent-LoRA: Compact Latent-Space Adapters with Gradient-Free Routing for Continual Learning

    arXiv:2607.23837v1 Announce Type: cross Abstract: Large language models generalize well to individual tasks but lack an inherent mechanism for learning them sequentially, leading to catastrophic forgetting. To mitigate this, LoRA-based continual learning methods allocate a separa…

  2. arXiv cs.LG TIER_1 English(EN) · Grzegorz Rype\'s\'c ·

    Gradient-Free Continual Learning

    arXiv:2504.01219v2 Announce Type: replace Abstract: Neural networks are notorious for forgetting old skills when taught new ones - a problem known as catastrophic forgetting. Standard continual learning techniques try to fix this by saving old data or relying on complex gradient …

  3. arXiv cs.CV TIER_1 English(EN) · De Cheng, Yue Lu, Lingfeng He, Shizhou Zhang, Xi Yang, Nannan Wang, Xinbo Gao ·

    Mamba-CL: Optimizing Selective State Space Model in Null Space for Continual Learning

    arXiv:2411.15469v3 Announce Type: replace Abstract: Continual Learning (CL) aims to equip AI models with the ability to learn a sequence of tasks over time, without forgetting previously learned knowledge. Recently, State Space Models (SSMs), particularly the Mamba model, have ac…