English(EN) FedSEAM: Federated Continual Learning of LLMs via Subspace Expert Agreement Merging

新的FedSEAM框架支持跨客户端的LLM持续学习

作者 PulseAugur 编辑部 · [1 个来源] · 2026-10-28 04:00

研究人员开发了FedSEAM，一个用于大型语言模型联邦持续学习的新框架。该方法允许模型从多个客户端学习，而无需共享数据，同时还能保留先前任务的知识。FedSEAM将任务知识组织成稀疏专家，并使用基于子空间的兼容性测试来确定重用哪些专家以及在哪里引入新容量。该框架还在服务器端采用子空间专家协议合并（SEAM）来引导客户端达成共识，而不会破坏特定任务的专业化，从而解决路由漂移和合并擦除等问题。 AI

影响这项研究可能能够实现跨分布式数据集的更高效、更私密的LLM训练。

排序理由该集群包含一篇研究论文，详细介绍了LLM联邦持续学习的新框架。[lever_c_demoted from research: ic=1 ai=1.0]

在 arXiv cs.LG 阅读 →

AI 生成摘要 · Google Gemini · 来自 1 个来源。我们如何撰写摘要 →

本文如何被排名

Signal score: 16 / 100; Composite score across the factors below. Higher = stronger signal that this story matters right now.
Newsworthiness bucket: Tool; 该集群包含一篇研究论文，详细介绍了LLM联邦持续学习的新框架。[lever_c_demoted from research: ic=1 ai=1.0]
Source corroboration: Single-source cluster; Only one publisher covered this so far. Single-source stories can still rank when the publisher is high-authority, but they lack cross-source corroboration.
Topics: paper, model release; Editorial topic classification. Feeds into how the story surfaces on /topic/<slug> hub pages and into the per-entity coverage mix.
AI-industry relevance: High; Clearly on-topic for AI-industry coverage.
Story freshness: Breaking (< 6h); Fresh story with cross-source coverage still developing. Ranking may shift as more sources report.

完整方法见我们的编辑标准。

报道来源 [1]

arXiv cs.LG TIER_1 English(EN) · Fatema Siddika, Abhijit Chunduru, Zilinghan Li, Ali Jannesari, Ravi Madduri · 2026-10-28 04:00

FedSEAM：通过子空间专家协议合并进行LLM的联邦持续学习

arXiv:2610.33496v1 Announce Type: new Abstract: Federated continual learning trains a model on a sequence of tasks across several clients without sharing their data while retaining knowledge of earlier tasks. Sparse mixture-of-experts models support this setting by adapting selec…

本文如何被排名

报道来源 [1]

FedSEAM：通过子空间专家协议合并进行LLM的联邦持续学习

相关实体

相关话题