PulseAugur
中
实时 09:14:13
English(EN) VELD-QA: A Large-Scale Dataset for Visual Evidence Grounding and Question Answering in Long Documents

新的VELD-QA基准针对长文档中的视觉证据

研究人员推出了VELD-QA,这是一个新推出的、大规模的基准,旨在评估长文档中视觉证据的定位和问答能力。该基准包含 15,000 个由人类编写的问答对,这些问答对源自 5,859 份真实世界的 PDF 文件,总计超过 370,000 页。VELD-QA 包含支持页面和视觉元素的详细注释,可以分别评估检索和解读能力。对九个视觉语言模型和七个检索增强系统的评估显示,在证据定位和解读方面存在重大挑战,表明即使能够完全访问文档,性能仍然有限。 AI

影响 该基准旨在通过识别视觉解读和证据定位方面的瓶颈来改进多模态文档问答系统。

排序理由 该条目描述了一个用于研究目的的新学术数据集和基准。[lever_c_demoted from research: ic=1 ai=1.0]

在 arXiv cs.CL 阅读 →

AI 生成摘要 · Google Gemini · 来自 1 个来源。 我们如何撰写摘要 →

新的VELD-QA基准针对长文档中的视觉证据

本文如何被排名

Signal score
14 / 100
Composite score across the factors below. Higher = stronger signal that this story matters right now.
Newsworthiness bucket
Tool
该条目描述了一个用于研究目的的新学术数据集和基准。[lever_c_demoted from research: ic=1 ai=1.0]
Source corroboration
Single-source cluster
Only one publisher covered this so far. Single-source stories can still rank when the publisher is high-authority, but they lack cross-source corroboration.
Topics
paper, other
Editorial topic classification. Feeds into how the story surfaces on /topic/<slug> hub pages and into the per-entity coverage mix.
AI-industry relevance
High
Clearly on-topic for AI-industry coverage.
Story freshness
Breaking (< 6h)
Fresh story with cross-source coverage still developing. Ranking may shift as more sources report.

完整方法见我们的编辑标准。

报道来源 [1]

  1. arXiv cs.CL TIER_1 English(EN) · Zhivar Sourati, Marianne Menglin Liu, Rongguang Wang, Zheng Wang, Yazhe Hu, Lan Guo, Yuying Wang, Mengqing Guo, Bhavesh Dnyaneshwar Gore, Shubham Pathak, Ramapriya Ranganath, Sandeep Sharma, Tao Sheng, Sujith Ravi, Dan Roth ·

    VELD-QA:长文档中的视觉证据定位与问答大规模数据集

    arXiv:2610.20964v1 Announce Type: cross Abstract: Existing long-document QA benchmarks rarely combine large-scale human-authored questions with detailed visual evidence annotations, limiting diagnosis of evidence localization and interpretation failures. We present VELD-QA, a lar…