New framework fuses facial and physiological signals for better emotion recognition

Researchers have developed a new framework for video-based emotion recognition that combines facial expressions with physiological signals from remote photoplethysmography (rPPG). Their method uses prompt tuning to integrate rPPG information into a Vision Transformer while preserving pre-trained facial representations. Additionally, a decoupled adapter is employed to separate subject-shared and subject-specific components, enhancing generalization across different individuals. AI

影响 Introduces a novel approach to multimodal emotion recognition, potentially improving accuracy and generalization in affective computing applications.

排序理由 This is a research paper detailing a novel framework for emotion recognition. [lever_c_demoted from research: ic=1 ai=1.0]

在 arXiv cs.CV 阅读 →

• arXiv
• DEAP
• MAHNOB-HCI
• Vision Transformer

• 论文
• 其他

AI 生成摘要 · Google Gemini · 来自 1 个来源。 我们如何撰写摘要 →