Researchers have introduced Kandinsky S2V 1.0, a new family of open-source models designed for generating human avatar videos driven by audio. The models, available in Lite (2B parameters) and Pro (21B parameters) versions, can produce long-form videos with synchronized lip movements, expressions, and gestures from a single reference image, speech waveform, and text prompt. Evaluations show that Kandinsky S2V 1.0 Pro performs comparably to or better than leading open-source and proprietary models, particularly in lip synchronization. The project also includes distilled variants for faster generation and releases code, checkpoints, and integrations under the MIT license to foster open research. AI
IMPACT Accelerates open research in audio-driven avatar video generation with the release of performant, open-source models.
RANK_REASON The item describes a new research paper detailing a novel model family for audio-driven video generation, including performance benchmarks and code release. [lever_c_demoted from research: ic=1 ai=1.0]
- arXiv
- Hugging Face
- Kandinsky 5.0
- Kandinsky S2V 1.0
- Kandinsky S2V 1.0 Lite
- Kandinsky S2V 1.0 Pro
- MIT License
- Qwen2.5 Omni
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →