PulseAugur
EN
LIVE 15:13:27

New arXiv papers survey and generate realistic talking heads

Two new arXiv papers explore advancements in generating realistic talking heads. The first paper provides a comprehensive survey of existing techniques, categorizing them into image-driven, audio-driven, video-driven, and 3D/neural-rendering-based approaches, while also analyzing current limitations and future challenges. The second paper introduces CHAT, a framework that generates paired, responsive audio-visual dialogue clips from text prompts, aiming to create a scalable alternative to collecting real-world dialogue data. AI

IMPACT These papers advance the state-of-the-art in realistic digital human generation, with implications for virtual agents and content creation.

RANK_REASON Two academic papers published on arXiv detailing new methods and surveys in talking head generation.

Read on arXiv cs.CV →

AI-generated summary · Google Gemini · from 2 sources. How we write summaries →

New arXiv papers survey and generate realistic talking heads

COVERAGE [2]

  1. arXiv cs.CV TIER_1 English(EN) · Shreyank N Gowda, Dheeraj Pandey, Shashank Narayana Gowda ·

    From Pixels to Portraits: A Comprehensive Survey of Talking Head Generation Techniques and Applications

    arXiv:2308.16041v2 Announce Type: replace Abstract: Talking head generation has progressed rapidly from landmark- and GAN-based facial animation to diffusion models, neural rendering, 3D-aware avatars, and foundation-model-assisted systems. This progress has enabled increasingly …

  2. arXiv cs.CV TIER_1 English(EN) · Junhao Song, Lluis Guasch, Xilin He, Zhongyu Yang, Yingfang Yuan, Weicheng Xie, Linlin Shen, Haijun Lin, Shizhe Liu, Wei Pang, Siyang Song ·

    Conversational Human Audio-visual Talking Dialogue Generation

    arXiv:2607.02799v1 Announce Type: new Abstract: Large-scale dyadic interactive audio-visual dialogue (DIAD) datasets provide fundamental data resources for developing humanoid interactive virtual agents and digital humans. However, collecting such data is time-consuming, expensiv…