A research paper titled Vorch-Human, which proposed a unified framework for human-centric audio-visual generation, has been withdrawn by its author, Yaohui Wang. The framework utilized a dual-stream audio-video diffusion transformer to handle tasks such as animating a person from speech, generating speech and video from a voice reference, and synthesizing scenes from appearance and voice references. The paper detailed a two-level data pipeline for annotation and adapted the model for long-form generation, demonstrating improved identity preservation and synchronization. AI
IMPACT A proposed unified framework for human-centric audio-visual generation has been withdrawn, indicating potential issues with its methodology or findings.
RANK_REASON The cluster contains a withdrawn academic paper. [lever_c_demoted from research: ic=1 ai=1.0]
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →