PulseAugur
EN
LIVE 05:42:23

Motion-Omni integrates speech and full-body avatar motion in one framework

By PulseAugur Editorial · [2 sources] ·

Researchers have developed Motion-Omni, an end-to-end framework that integrates speech generation with full-body avatar motion. Unlike cascaded systems, Motion-Omni allows for joint optimization between speech and motion generation, resulting in more aligned and natural avatar movements. The system, instantiated with a Qwen2.5-7B-Instruct model, demonstrates faster response times and competitive performance on motion metrics while maintaining low word error rates. AI

IMPACT Enables more natural and responsive avatar interactions by unifying speech and motion generation.

RANK_REASON Academic paper detailing a new framework for joint speech and motion generation. [lever_c_demoted from research: ic=1 ai=1.0]

Read on Hugging Face Daily Papers →

AI-generated summary · Google Gemini · from 2 sources. How we write summaries →

Motion-Omni integrates speech and full-body avatar motion in one framework

How we ranked this

Signal score
0 / 100
Composite score across the factors below. Higher = stronger signal that this story matters right now.
Newsworthiness bucket
Tool
Academic paper detailing a new framework for joint speech and motion generation. [lever_c_demoted from research: ic=1 ai=1.0]
Source corroboration
2 independent sources
Multiple independent publishers reporting the same story raises confidence that it's real and newsworthy.
Topics
model release, paper, product
Editorial topic classification. Feeds into how the story surfaces on /topic/<slug> hub pages and into the per-entity coverage mix.
AI-industry relevance
High
Clearly on-topic for AI-industry coverage.
Story freshness
10 days old
Aged out of breaking-news scoring windows; ranking reflects the durable signal from the full source set.
Coverage growth since scoring
+1 source(s) since last score
New sources have picked up this story since our last re-score. Score will update on the next scoring pass.

Full methodology in our editorial standards.

COVERAGE [2]

  1. Hugging Face Daily Papers TIER_1 English(EN) ·

    Motion-Omni: End-to-End Joint Speech and Full-Body Motion for Spoken Dialogue

    Motion-Omni is an end-to-end framework that jointly generates spoken dialogue and full-body co-speech motion from shared hidden states, using scalable pseudo-labeling and a unified evaluation protocol to achieve real-time, aligned responses.

  2. arXiv cs.CV TIER_1 English(EN) · Chengqian Ma, Wei Tao, Haoyu Zhang, Yiwen Guo ·

    Motion-Omni: End-to-End Joint Speech and Full-Body Motion for Spoken Dialogue

    arXiv:2609.04250v1 Announce Type: cross Abstract: An avatar that holds a conversation should decide what to say and to move while saying it, yet these abilities live in separate model families: spoken dialogue models produce speech without motion, and co-speech motion models prod…

RELATED ENTITIES

RELATED TOPICS