PulseAugur
EN
LIVE 10:01:06

New Framework Enhances Micro-Gesture Recognition with Multi-Modal Approach

By PulseAugur Editorial · [2 sources] ·

Researchers have developed a new multi-modal framework for micro-gesture recognition, addressing challenges like low signal-to-noise ratio and cross-subject generalization. The system integrates skeleton joint coordinates, 3D heatmap volumes, and RGB visual features, employing a novel Cross-Modal Pseudo-Labeling strategy for domain adaptation. This approach achieved a competitive F1-score of 68.13%, securing 4th place in the 4th MiGA-IJCAI Challenge. AI

IMPACT This research advances micro-gesture recognition capabilities, potentially improving human-computer interaction and emotion detection systems.

RANK_REASON This is a research paper detailing a new framework for micro-gesture recognition.

Read on arXiv cs.CV →

AI-generated summary · Google Gemini · from 2 sources. How we write summaries →

COVERAGE [2]

  1. arXiv cs.CV TIER_1 English(EN) · Haoran Zhang, Haokun Zhang, Pengyu Liu, Yujia Zhang, Weibao Xue, Yanbin Hao ·

    A Multi-Modal Framework with Cross-Subject Pseudo-Labeling and Semantic Alignment for Micro-Gesture Recognition

    arXiv:2606.13030v1 Announce Type: new Abstract: Micro-gestures (MGs) are spontaneous and subtle body movements that frequently convey hidden human emotions. Recognizing MGs in untrimmed videos remains highly challenging due to their extremely low signal-to-noise ratio, severe lon…

  2. arXiv cs.CV TIER_1 English(EN) · Yanbin Hao ·

    A Multi-Modal Framework with Cross-Subject Pseudo-Labeling and Semantic Alignment for Micro-Gesture Recognition

    Micro-gestures (MGs) are spontaneous and subtle body movements that frequently convey hidden human emotions. Recognizing MGs in untrimmed videos remains highly challenging due to their extremely low signal-to-noise ratio, severe long-tailed class distribution, and the inherent do…

RELATED TOPICS