New framework uses conditional diffusion models for multimodal federated learning

Researchers have developed a new framework called CondI to address missing data in multimodal federated learning, particularly in clinical settings. This approach uses conditional diffusion models to explicitly impute unobserved data points within a modality, leveraging available multimodal context. The framework trains modality-specific extractors and joint embedding spaces, enabling models to operate on complete semantic structures and improving resilience to data incompleteness. Experiments on clinical datasets showed CondI achieved results comparable to existing state-of-the-art methods. AI

IMPACT Improves robustness of multimodal models in clinical settings with missing data, potentially enabling wider adoption of federated learning for sensitive data.

RANK_REASON This is a research paper published on arXiv detailing a new framework for multimodal federated learning.

Read on arXiv cs.LG →

• arXiv
• MIMIC-IV
• PTB-XL
• SLEEP-EDF

• paper
• other

AI-generated summary · Google Gemini · from 1 sources. How we write summaries →