English(EN) The Shape of Speech: A Geometric Measure of Coarticulation for Speech-Driven 3D Facial Animation

新测量方法揭示语音动画丢失了关键的协发音

作者 PulseAugur 编辑部 · [1 个来源] · 2026-10-05 04:00

研究人员开发了一种新的几何测量方法，用于量化语音驱动的3D面部动画中的协发音（即周围声音对语音发音的影响）。这种称为唇部路径长度的测量方法将实际运动轨迹与音位位置之间的最短路径进行比较。当应用于四种领先的动画方法——DiffPoseTalk、ARTalk、FaceFormer和CodeTalker——时，发现所有方法都比真实语音简化了唇部轨迹，其中三种方法显示出明显的缺陷。一项包含超过3500次判断的观看者研究证实，观看者更喜欢真实语音，并对夸张或过于简化的唇部运动进行惩罚，这突显了合成发音的一个关键改进领域。 AI

影响识别出语音驱动动画中特定的感知缺陷，为未来的模型开发提供了目标。

排序理由介绍新方法和评估的学术论文。[lever_c_demoted from research: ic=1 ai=1.0]

在 arXiv cs.CV 阅读 →

AI 生成摘要 · Google Gemini · 来自 1 个来源。我们如何撰写摘要 →

本文如何被排名

Signal score: 0 / 100; Composite score across the factors below. Higher = stronger signal that this story matters right now.
Newsworthiness bucket: Tool; 介绍新方法和评估的学术论文。[lever_c_demoted from research: ic=1 ai=1.0]
Source corroboration: Single-source cluster; Only one publisher covered this so far. Single-source stories can still rank when the publisher is high-authority, but they lack cross-source corroboration.
Topics: paper, other; Editorial topic classification. Feeds into how the story surfaces on /topic/<slug> hub pages and into the per-entity coverage mix.
AI-industry relevance: High; Clearly on-topic for AI-industry coverage.
Story freshness: 3 days old; Aged out of breaking-news scoring windows; ranking reflects the durable signal from the full source set.

完整方法见我们的编辑标准。

报道来源 [1]

arXiv cs.CV TIER_1 English(EN) · Danzel Serrano, Przemyslaw Musialski · 2026-10-05 04:00

语音的形状：一种用于语音驱动的3D面部动画的协发音几何度量

arXiv:2610.03436v1 Announce Type: cross Abstract: Speech-driven 3D facial animation can reproduce recognizable mouth poses. However, it can simplify the motion between them, and that motion carries coarticulation, the way the sounds around each sound shape its articulation. We in…

本文如何被排名

报道来源 [1]

语音的形状：一种用于语音驱动的3D面部动画的协发音几何度量

相关实体

相关话题