PulseAugur
实时 03:11:33
English(EN) Friendly federated learning 🌼

新的联邦学习方法应对数据异构性和可扩展性挑战

研究人员开发了几种新方法来改进联邦学习,这是一种分布式机器学习方法,可以在不共享原始信息的情况下对去中心化数据进行模型训练。FedHarmony 通过引入共识机制解决了跨异构客户端数据建模标签相关性的挑战。“谁来训练很重要”通过提出一种逆概率加权聚合方案来解决联邦学习中的选择偏差,以确保训练的代表性。此外,子空间优化 (SSF)、FedSLoPGradsSharding 等新技术旨在通过减少通信和内存开销来提高效率,尤其是在无服务器平台上训练大型模型时。 AI

影响 新的联邦学习算法有望提高效率和准确性,尤其是在大型模型和异构数据方面。

排序理由 多篇关于联邦学习新算法和框架的研究论文。

在 Practical AI 阅读 →

AI 生成摘要 · Google Gemini · 来自 19 个来源。 我们如何撰写摘要 →

新的联邦学习方法应对数据异构性和可扩展性挑战

报道来源 [19]

  1. arXiv cs.LG TIER_1 English(EN) · Zhiqiang Kou, Junxiang Wu, Wenke Huang, Wenwen He, Ming-Kun Xie, Changwei Wang, Yuheng Jia, Di Jiang, Yang Liu, Xin Geng, Qiang Yang ·

    FedHarmony: Harmonizing Heterogeneous Label Correlations in Federated Multi-Label Learning

    arXiv:2604.28024v1 Announce Type: new Abstract: Federated Multi-Label Learning is a distributed paradigm where multiple clients possess heterogeneous multi-label data and perform collaborative learning under privacy constraints without sharing raw data. However, modeling label co…

  2. arXiv cs.LG TIER_1 English(EN) · Qiang Yang ·

    FedHarmony: Harmonizing Heterogeneous Label Correlations in Federated Multi-Label Learning

    Federated Multi-Label Learning is a distributed paradigm where multiple clients possess heterogeneous multi-label data and perform collaborative learning under privacy constraints without sharing raw data. However, modeling label correlations under heterogeneous distributions rem…

  3. arXiv cs.LG TIER_1 English(EN) · Gota Morishita ·

    Who Trains Matters: Federated Learning under Enrollment and Participation Selection Biases

    arXiv:2604.26604v1 Announce Type: new Abstract: Federated learning (FL) trains a shared model from updates contributed by distributed clients, often implicitly assuming that contributing clients are representative of the target population. In practice, this representativeness ass…

  4. arXiv cs.LG TIER_1 English(EN) · Gota Morishita ·

    Who Trains Matters: Federated Learning under Enrollment and Participation Selection Biases

    Federated learning (FL) trains a shared model from updates contributed by distributed clients, often implicitly assuming that contributing clients are representative of the target population. In practice, this representativeness assumption can fail at two distinct stages, inducin…

  5. arXiv cs.LG TIER_1 English(EN) · Shuchen Zhu, Zhengyang Huang, Yuqi Xu, Peijin Li ·

    Subspace Optimization for Efficient Federated Learning under Heterogeneous Data

    arXiv:2604.25467v1 Announce Type: new Abstract: Federated learning increasingly operates in a large-model regime where communication, memory, and computation are all scarce. Typically, non-IID client data induce drift that degrades the stability and performance of local training.…

  6. arXiv cs.LG TIER_1 English(EN) · Peijin Li ·

    Subspace Optimization for Efficient Federated Learning under Heterogeneous Data

    Federated learning increasingly operates in a large-model regime where communication, memory, and computation are all scarce. Typically, non-IID client data induce drift that degrades the stability and performance of local training. Existing remedies such as SCAFFOLD introduce he…

  7. arXiv cs.LG TIER_1 English(EN) · Yutong He, Zhengyang Huang, Jiahe Geng ·

    FedSLoP: Memory-Efficient Federated Learning with Low-Rank Gradient Projection

    arXiv:2604.24012v1 Announce Type: new Abstract: Federated learning enables a population of clients to collaboratively train machine learning models without exchanging their raw data, but standard algorithms such as FedAvg suffer from slow convergence and high communication and me…

  8. arXiv cs.LG TIER_1 English(EN) · Taehwan Yoon, Bongjun Choi, Wesley De Neve ·

    FedRef: Bayesian Fine-Tuning using a Reference Model to Mitigate Catastrophic Forgetting for Heterogeneous Federated Learning

    arXiv:2506.23210v5 Announce Type: replace Abstract: Federated learning (FL) enables collaborative model training across distributed clients while preserving data privacy. However, data and system heterogeneity often cause catastrophic forgetting and unbounded drift in model updat…

  9. arXiv cs.AI TIER_1 English(EN) · Amine Barrak ·

    Shard the Gradient, Scale the Model: Serverless Federated Aggregation via Gradient Partitioning

    arXiv:2604.22072v1 Announce Type: cross Abstract: Federated learning (FL) aggregation on serverless platforms faces a hard scalability ceiling: existing architectures (lambda-FL, LIFL) partition clients across aggregators, but every aggregator must hold the complete model gradien…

  10. arXiv cs.AI TIER_1 English(EN) · Amine Barrak ·

    Shard the Gradient, Scale the Model: Serverless Federated Aggregation via Gradient Partitioning

    Federated learning (FL) aggregation on serverless platforms faces a hard scalability ceiling: existing architectures (lambda-FL, LIFL) partition clients across aggregators, but every aggregator must hold the complete model gradient in memory. When gradients exceed the per-functio…

  11. Hugging Face Daily Papers TIER_1 English(EN) ·

    Decision-Focused Federated Learning Under Heterogeneous Objectives and Constraints

    We consider what we refer to as {Decision-Focused Federated Learning (DFFL)} framework, i.e., a predict-then-optimize approach employed by a collection of agents, where each agent's predictive model is an input to a downstream linear optimization problem, and no direct exchange o…

  12. arXiv cs.CV TIER_1 English(EN) · Mahad Ali, Laura J. Brattain ·

    FMCL: Class-Aware Client Clustering with Foundation Model Representations for Heterogeneous Federated Learning

    arXiv:2604.27510v1 Announce Type: cross Abstract: Federated Learning (FL) enables collaborative model training across distributed clients without sharing raw data, yet its performance deteriorates under statistical heterogeneity. Clustered Federated Learning addresses this challe…

  13. arXiv cs.CV TIER_1 English(EN) · Laura J. Brattain ·

    FMCL: Class-Aware Client Clustering with Foundation Model Representations for Heterogeneous Federated Learning

    Federated Learning (FL) enables collaborative model training across distributed clients without sharing raw data, yet its performance deteriorates under statistical heterogeneity. Clustered Federated Learning addresses this challenge by grouping similar clients and training separ…

  14. arXiv cs.CV TIER_1 English(EN) · Emre Ard{\i}\c{c}, Yakup Gen\c{c} ·

    Sample Selection Using Multi-Task Autoencoders in Federated Learning with Non-IID Data

    arXiv:2604.26116v1 Announce Type: new Abstract: Federated learning is a machine learning paradigm in which multiple devices collaboratively train a model under the supervision of a central server while ensuring data privacy. However, its performance is often hindered by redundant…

  15. arXiv stat.ML TIER_1 English(EN) · Alexander Vinel ·

    Decision-Focused Federated Learning Under Heterogeneous Objectives and Constraints

    We consider what we refer to as {Decision-Focused Federated Learning (DFFL)} framework, i.e., a predict-then-optimize approach employed by a collection of agents, where each agent's predictive model is an input to a downstream linear optimization problem, and no direct exchange o…

  16. arXiv stat.ML TIER_1 English(EN) · Xiaolei Fang ·

    Heterogeneity-Aware Personalized Federated Learning for Industrial Predictive Analytics

    Federated prognostics enable clients (e.g., companies, factories, and production lines) to collaboratively develop a failure time prediction model while keeping each client's data local and confidential. However, traditional federated models often assume homogeneity in the degrad…

  17. Practical AI TIER_1 English(EN) · Practical AI LLC ·

    Friendly federated learning 🌼

    <p>This episode is a follow up to our recent Fully Connected <a href="https://practicalai.fm/153">show discussing federated learning</a>. In that previous discussion, we mentioned <a href="https://flower.dev/">Flower</a> (a “friendly” federated learning framework). Well, one of t…

  18. Practical AI TIER_1 English(EN) · Practical AI LLC ·

    Federated Learning 📱

    <p>Federated learning is increasingly practical for machine learning developers because of the challenges we face with model and data privacy. In this fully connected episode, Chris and Daniel dive into the topic and dissect the ideas behind federated learning, practicalities of …

  19. Mastodon — fosstodon.org TIER_1 Русский(RU) · [email protected] ·

    Federated Learning with Memory Constraints on Edge Devices. Part 2 How to Train ML Models on Edge Devices with <256MB Memory? Hello, Habr! I am Ale

    Федеративное обучение в условиях дефицита памяти на Edge-устройствах. Часть 2 Как обучить ML-модели на Edge-устройствах с памятью <256 МБ? Привет, Хабр! Я — Александр Лошкарев, инженер-программист, и это вторая часть материала о федеративном обучении. В https:// habr.com/ru/compa…