New ADMC model enhances multimodal emotion and intent recognition

Researchers have developed ADMC, an Attention-based Diffusion Model designed to complete missing modality features in multimodal emotion and intent recognition. This framework trains separate feature extraction networks for each modality to prevent over-coupling and uses an Attention-based Diffusion Network (ADN) to generate missing features that closely match authentic multimodal distributions. The ADMC approach demonstrates state-of-the-art performance on the IEMOCAP and MIntRec benchmarks, proving effective in scenarios with both missing and complete modalities. AI

IMPACT This model could improve the robustness of AI systems in real-world scenarios where data from all modalities is not consistently available.

RANK_REASON The cluster describes a new research paper detailing a novel model for feature completion in multimodal recognition. [lever_c_demoted from research: ic=1 ai=1.0]

Read on arXiv cs.AI →

• arXiv
• Attention-based Diffusion Model for Missing Modalities Feature Completion
• Attention-based Diffusion Network
• IEMOCAP: interactive emotional dyadic motion capture database
• MIntRec
• Wei Zhang

• paper
• model release

AI-generated summary · Google Gemini · from 1 sources. How we write summaries →