PulseAugur
EN
LIVE 17:21:33

New model integrates language captions for 3D human motion prediction

Researchers have developed ZGL, a novel language-conditioned predictor for 3D human motion prediction. This model integrates semantic guidance from motion captions into a Transformer architecture, using compact cross-attention adapters with zero gates. This approach allows the model to learn from language conditioning only when it improves prediction accuracy. ZGL demonstrates enhanced performance on the Human3.6M dataset and shows effective transferability to the CMUMocap benchmark. AI

IMPACT This model could enhance the realism and controllability of generated human motion by incorporating semantic understanding from language.

RANK_REASON The item describes a new research paper introducing a novel model for human motion prediction. [lever_c_demoted from research: ic=1 ai=1.0]

Read on Hugging Face Daily Papers →

AI-generated summary · Google Gemini · from 1 sources. How we write summaries →

New model integrates language captions for 3D human motion prediction

COVERAGE [1]

  1. Hugging Face Daily Papers TIER_1 English(EN) ·

    Zero-Gated Language-conditioned Human Motion Prediction

    Pose histories provide the core kinematic evidence for 3D human motion prediction, but they lack explicit high-level semantic guidance. This paper introduces ZGL, a lightweight language-conditioned predictor that uses captions of the observed motion as a semantic prior while pres…