PulseAugur
实时 10:09:25
English(EN) SVF-CR: Synchronized Visual-Facial Cross-Refinement for Multimodal Ambivalence and Hesitancy Recognition

AI系统在视频分析中提升矛盾和犹豫识别能力 · 跟踪8个来源

研究人员开发了识别视频中矛盾和犹豫的先进方法,参加了第11届ABAW挑战赛。其中一种方法,HSEmotion团队的系统,利用多任务学习,结合冻结的轻量级面部提取器和后处理技术来预测效价、唤醒度、面部表情和动作单元。另一个系统SVF-CR采用同步视觉-面部交叉精炼框架进行多模态证据融合。第三种方法侧重于简单特征和诚实校准,引入“ASR擦除时间”来捕捉犹豫停顿,并使用称为情感标记融合的可靠性门控。 AI

影响 多模态AI在细微人类情感检测方面的进步可以改进人机交互和行为分析工具。

排序理由 多篇研究论文详细介绍了用于视频分析和情感识别的新颖方法,并提交给了一项挑战赛。

在 arXiv cs.AI 阅读 →

AI 生成摘要 · Google Gemini · 来自 8 个来源。 我们如何撰写摘要 →

AI系统在视频分析中提升矛盾和犹豫识别能力 · 跟踪8个来源

报道来源 [8]

  1. arXiv cs.AI TIER_1 English(EN) · Aleksei Bakin, Andrey V. Savchenko ·

    HSEmotion团队在第11届ABAW挑战赛上:多任务学习与矛盾/犹豫视频识别

    arXiv:2607.12774v1 Announce Type: cross Abstract: This article presents our results for the 11th Affective Behavior Analysis in-the-Wild (ABAW) competition. For multi-task learning with simultaneous prediction of valence, arousal, facial expressions, and action units on s-Aff-Wil…

  2. arXiv cs.CL TIER_1 English(EN) · Vikas Kumar, Aditya Mishra, Haroon R. Lone ·

    Simple Features and Honest Calibration for Ambivalence and Hesitancy Recognition in Video

    arXiv:2607.11120v1 Announce Type: cross Abstract: We address ambivalence and hesitancy (A/H) recognition in the ABAW 2026 BAH Challenge: given a short interview video, predict whether the person shows signs of A/H. Our system combines affect-specialised text, audio, and visual re…

  3. arXiv cs.CL TIER_1 English(EN) · Haroon R. Lone ·

    视频中用于识别矛盾和犹豫的简单特征和诚实校准

    We address ambivalence and hesitancy (A/H) recognition in the ABAW 2026 BAH Challenge: given a short interview video, predict whether the person shows signs of A/H. Our system combines affect-specialised text, audio, and visual representations with a small set of readable linguis…

  4. Hugging Face Daily Papers TIER_1 English(EN) ·

    Simple Features and Honest Calibration for Ambivalence and Hesitancy Recognition in Video

    We address ambivalence and hesitancy (A/H) recognition in the ABAW 2026 BAH Challenge: given a short interview video, predict whether the person shows signs of A/H. Our system combines affect-specialised text, audio, and visual representations with a small set of readable linguis…

  5. arXiv cs.AI TIER_1 English(EN) · Hyein Park, Namho Kim, Junhwa Kim ·

    SVF-CR: Synchronized Visual-Facial Cross-Refinement for Multimodal Ambivalence and Hesitancy Recognition

    arXiv:2607.09417v1 Announce Type: cross Abstract: Ambivalence and hesitancy are subtle behavioral states that are expressed through a combination of verbal content, facial behavior, visual context, and acoustic cues. Effective recognition therefore requires not only extracting in…

  6. arXiv cs.AI TIER_1 English(EN) · Junhwa Kim ·

    SVF-CR:用于多模态矛盾和犹豫识别的同步视觉面部交叉精炼

    Ambivalence and hesitancy are subtle behavioral states that are expressed through a combination of verbal content, facial behavior, visual context, and acoustic cues. Effective recognition therefore requires not only extracting informative unimodal representations, but also model…

  7. arXiv cs.CV TIER_1 English(EN) · Josep Cabacas-Maso, Ismael Benito-Altamirano, Carles Ventura ·

    一种用于识别矛盾/犹豫的校准多模态集成:系统描述和私有测试提交策略

    arXiv:2607.12176v1 Announce Type: new Abstract: Ambivalence and hesitancy (A/H) undermine digital behaviour-change interventions, and recognizing them automatically from video is the goal of the ABAW A/H challenge on the BAH dataset. We describe our system for the 11th edition of…

  8. arXiv cs.CV TIER_1 English(EN) · Andrey V. Savchenko ·

    HSEmotion团队在第11届ABAW挑战赛上:多任务学习与矛盾/犹豫视频识别

    This article presents our results for the 11th Affective Behavior Analysis in-the-Wild (ABAW) competition. For multi-task learning with simultaneous prediction of valence, arousal, facial expressions, and action units on s-Aff-Wild2 dataset, we use frozen lightweight facial extra…