PulseAugur
EN
LIVE 09:17:08

GenPrior framework uses text-to-motion priors for zero-shot action recognition

Researchers have introduced GenPrior, a novel framework designed to improve zero-shot skeleton-based action recognition by leveraging generative priors from pre-trained Text-to-Motion (T2M) models. This approach addresses the semantic-kinematic gap in existing methods by distilling kinematic prototypes and intra-class dispersion from generated motion sequences. GenPrior utilizes a gating network to integrate structural cues from motion data while mitigating synthetic artifacts, and refines class prototypes by mining high-confidence unseen samples. Experiments on benchmark datasets like NTU-60, NTU-120, and PKU-MMD show that GenPrior achieves state-of-the-art results in both zero-shot and generalized zero-shot settings. AI

IMPACT This research could lead to more accurate and robust action recognition systems by better aligning textual descriptions with physical motion, potentially impacting fields like surveillance, robotics, and human-computer interaction.

RANK_REASON The cluster describes a new research paper detailing a novel framework for action recognition. [lever_c_demoted from research: ic=1 ai=1.0]

Read on arXiv cs.CV →

AI-generated summary · Google Gemini · from 1 sources. How we write summaries →

GenPrior framework uses text-to-motion priors for zero-shot action recognition

COVERAGE [1]

  1. arXiv cs.CV TIER_1 English(EN) · Jidong Kuang, Hongsong Wang, Jie Gui ·

    GenPrior: Unleashing Text-to-Motion Generative Priors for Zero-Shot Skeleton-based Action Recognition

    arXiv:2608.02236v1 Announce Type: new Abstract: Zero-shot skeleton-based action recognition (ZSAR) aims to recognize unseen action categories by aligning skeleton features with textual semantics. However, existing methods rely on text-derived prototypes that inherently lack geome…