Researchers have introduced CAST-Bench, a new benchmark designed to evaluate text-to-audio-video (T2AV) generation systems by tracing each generated sound to its intended source. This benchmark addresses limitations in existing systems by ensuring sounds are correctly attributed, synchronized with visual actions, and semantically accurate across single and multi-shot scenarios. CAST-Bench organizes 900 prompts across nine sound-source categories and includes an 18-metric evaluation suite. Initial benchmarking of 12 systems revealed that while visual quality is high, audio semantic scores vary significantly, with multi-shot prompts posing particular challenges for consistency and event retention. AI
IMPACT This benchmark could drive improvements in the accuracy and coherence of AI-generated audio-video content.
RANK_REASON The item is a research paper detailing a new benchmark for evaluating AI models. [lever_c_demoted from research: ic=1 ai=1.0]
- alphaXiv
- arXiv
- CAST-Bench
- CatalyzeX Code Finder for Papers
- Connected Papers
- DagsHub
- Gotit.pub
- Hugging Face
- Influence Flower
- Litmaps
- ScienceCast
- scite Smart Citations
- T2AV
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →