PulseAugur
中
实时 08:44:32
English(EN) EvaOmni: An Evidence-Grounded Benchmark for Audio-Visual Reasoning

新的EvaOmni基准测试LLM的视听推理能力 · 已追踪2个来源

研究人员推出了EvaOmni,一个旨在评估全模态大语言模型视听推理能力的新基准。该基准要求模型不仅要回答问题,还要识别和定位支持其答案的具体视听证据,以解决现有基准可能允许“走捷径”的局限性。EvaOmni包含392个视频中的1,027个人工标注问答对,涵盖15种不同的能力。在评估中,Gemini3.7-Flash表现出最高的整体性能,准确率为79.4%,但其在证据关联和时间定位方面的得分表明先进模型仍有改进空间。 AI

影响 该基准将推动多模态AI系统中更强大的视听推理能力的发展。

排序理由 该集群描述了一个用于评估AI模型的新学术基准。

在 Hugging Face Daily Papers 阅读 →

AI 生成摘要 · Google Gemini · 来自 2 个来源。 我们如何撰写摘要 →

新的EvaOmni基准测试LLM的视听推理能力 · 已追踪2个来源

本文如何被排名

Signal score
0 / 100
Composite score across the factors below. Higher = stronger signal that this story matters right now.
Newsworthiness bucket
Research
该集群描述了一个用于评估AI模型的新学术基准。
Source corroboration
2 independent sources
Multiple independent publishers reporting the same story raises confidence that it's real and newsworthy.
Topics
paper, model release
Editorial topic classification. Feeds into how the story surfaces on /topic/<slug> hub pages and into the per-entity coverage mix.
AI-industry relevance
High
Clearly on-topic for AI-industry coverage.
Story freshness
30 days old
Aged out of breaking-news scoring windows; ranking reflects the durable signal from the full source set.

完整方法见我们的编辑标准。

报道来源 [2]

  1. Hugging Face Daily Papers TIER_1 English(EN) ·

    EvaOmni:一个基于证据的视听推理基准

    EvaOmni is an evidence-grounded benchmark that evaluates whether omnimodal language models identify audio-visual evidence and construct reasoning chains for audiovisual questions.

  2. arXiv cs.CV TIER_1 English(EN) · Xiaoxing Hu, Wenxi Yao, Chaoyuan Shi, Ziqi Ye, Xiaorong Guo, Peixuan Li, Zhuoran Sun, Ziyang Gong, Peiyuan Zhang, Mingxin Liu, Shuran Ma, Hongbo Liu, Xiaomin Yu, Yu Tian, Wentao Wang, Zhenjie Yang, Jian Hu, Yunhang Shen, Haoyu Cao, Xue Yang ·

    EvaOmni:一个基于证据的视听推理基准

    arXiv:2610.28444v1 Announce Type: new Abstract: Omni LLMs can naturally locate key audio and visual evidence and integrate information across modalities for audiovisual reasoning. Existing audio-visual reasoning benchmarks that mainly rely on multiple-choice questions usually sco…