New framework uses conditional diffusion models for multimodal federated learning

Researchers have developed a new framework called CondI to address missing data in multimodal federated learning, particularly in clinical settings. This approach uses conditional diffusion models to explicitly impute unobserved data points within a modality, leveraging available multimodal context. The framework trains modality-specific extractors and joint embedding spaces, enabling models to operate on complete semantic structures and improving resilience to data incompleteness. Experiments on clinical datasets showed CondI achieved results comparable to existing state-of-the-art methods. AI

影响 Improves robustness of multimodal models in clinical settings with missing data, potentially enabling wider adoption of federated learning for sensitive data.

排序理由 This is a research paper published on arXiv detailing a new framework for multimodal federated learning.

在 arXiv cs.LG 阅读 →

• arXiv
• MIMIC-IV
• PTB-XL
• SLEEP-EDF

• 论文
• 其他

AI 生成摘要 · Google Gemini · 来自 1 个来源。 我们如何撰写摘要 →