New AS-LoRA method improves privacy in federated learning

Researchers have developed AS-LoRA, a novel framework for adaptive selection of LoRA components in privacy-preserving federated learning. This method addresses aggregation errors common in such setups by allowing each layer to independently choose its active component and adapting these selections across communication rounds. AS-LoRA theoretically improves convergence speed and accuracy without increasing privacy costs, demonstrating significant gains on benchmarks like GLUE and SQuAD. AI

影响 Introduces a more efficient and accurate method for fine-tuning large models in federated learning settings, potentially improving privacy and performance.

排序理由 This is a research paper detailing a new method for federated learning. [lever_c_demoted from research: ic=1 ai=1.0]

在 arXiv cs.LG 阅读 →

• AS-LoRA
• CIFAR-100
• GLUE
• LoRA
• MNLI
• SQuAD
• Tiny-ImageNet

• 论文
• 安全

AI 生成摘要 · Google Gemini · 来自 1 个来源。 我们如何撰写摘要 →