Federated learning accuracy can hide critical model failures, study finds

A research project comparing federated learning algorithms for network intrusion detection revealed that high global accuracy can mask poor performance on minority data silos. The study found that FedAvg achieved 96% global accuracy but missed all attacks in a small 'Web Attacks' silo, which had only 3,000 samples out of 3 million. In contrast, FedNova demonstrated consistent high performance across all silos and seeds, highlighting the importance of per-client performance metrics and aggregation methods for rare attack detection. AI

IMPACT Highlights the critical need for robust evaluation metrics in federated learning, especially for imbalanced datasets, to ensure reliable performance in real-world applications.

RANK_REASON Research paper detailing findings on federated learning algorithms and evaluation metrics. [lever_c_demoted from research: ic=1 ai=1.0]

Read on r/MachineLearning →

• CICIDS2017
• FedAvg
• federated learning
• FedNova
• FedProx

• paper
• other

AI-generated summary · Google Gemini · from 1 sources. How we write summaries →