New framework enhances multimodal emotion recognition with missing data

Researchers have developed a new framework called Affect-Prototype-Conditioned Fusion (APCF) to improve open-vocabulary multimodal emotion recognition, particularly when some data modalities are missing. This candidate-free generative framework uses an affect-prototype library to dynamically constrain modal fusion based on diverse emotional semantics. Experiments on the OV-MERD+ and MER-FG datasets show that APCF significantly outperforms existing methods. AI

IMPACT Improves AI's ability to understand emotions from incomplete multimodal data, potentially enhancing human-AI interaction.

RANK_REASON Academic paper detailing a new framework for multimodal emotion recognition. [lever_c_demoted from research: ic=1 ai=1.0]

Read on arXiv cs.AI →

• Affect-Prototype Guided Fusion
• alphaXiv
• CatalyzeX
• DagsHub
• Gotit.pub
• Hugging Face
• Influence Flower
• MER-FG
• OV-MER
• OV-MERD+
• ScienceCast

• paper
• other

AI-generated summary · Google Gemini · from 1 sources. How we write summaries →