Researchers have introduced SonicWorld, a novel system designed for dynamic spatial audio reasoning, capable of associating acoustic observations with specific sound sources and determining their spatial states over time. To evaluate this capability, they developed Sonic-Bench, a benchmark dataset featuring simulated indoor scenes with associated question-answer pairs for localization, distance estimation, and motion reasoning tasks. SonicWorld integrates acoustic, semantic, and physical features into persistent source states, projecting them into an Omni LLM for reasoning, and demonstrated improved accuracy over the Spatial-Omni model on the benchmark and in zero-shot transfer tests. AI
RANK_REASON The cluster describes a new benchmark and a system for spatial audio reasoning, detailed in an arXiv paper. [lever_c_demoted from research: ic=1 ai=1.0]
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →