研究人员推出了OmniVideo-100K，这是一个旨在提高AI系统视听推理能力的新数据集。该数据集通过使用一个自动化引擎从视频创建结构化脚本，确保了跨片段的一致性并将音频链接到视觉来源，从而解决了当前方法的局限性。这种方法采用了实体锚定视频脚本和线索引导问答生成，在微调VITA-1.5和Qwen2.5-Omni-7B等模型时取得了显著的性能提升。 AI
影响 该数据集可以通过更好地整合音频和视觉信息来提高AI理解和推理视频内容的能力。
排序理由 该集群描述了一个用于AI视听推理的新数据集和相关的研究论文。
在 Hugging Face Daily Papers 阅读 →
AI 生成摘要 · Google Gemini · 来自 4 个来源。 我们如何撰写摘要 →
arXiv:2606.15141v1 Announce Type: cross Abstract: While LALMs show promise on audio question answering, they fail to focus on question-relevant segments of audio and provide a clear, checkable reasoning process when dealing with complex audio reasoning. Reinforcement learning and…
An automated audio-visual question answering system uses entity-anchored video scripting and clue-guided QA generation to improve cross-modal reasoning and temporal consistency in video analysis.
arXiv:2606.14702v1 Announce Type: new Abstract: Current automated pipelines for audio-visual Question Answering (QA) generally adopt a ``video-caption-QA'' paradigm. However, these methods typically segment videos into short clips and generate separate descriptions for audio and …
Current automated pipelines for audio-visual Question Answering (QA) generally adopt a ``video-caption-QA'' paradigm. However, these methods typically segment videos into short clips and generate separate descriptions for audio and visual modalities. This decoupled processing sev…