A new 6.3 billion parameter model named NAVA has been released, capable of generating synchronized audio and video from a single text prompt. It features multi-speaker speech control and image-conditioned continuations. NAVA utilizes an Align-then-Fuse MMDiT architecture to establish audio-video correspondence before fusing context, achieving state-of-the-art results on the Verse-Bench benchmark with significantly fewer parameters than existing open-source models. AI
IMPACT This model advances synchronized audio-video generation, potentially impacting content creation and media synthesis.
RANK_REASON The cluster describes the release of a new AI model with its technical details and benchmark performance. [lever_c_demoted from research: ic=1 ai=1.0]
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →
