English(EN)Sci-MMR: Benchmarking Multi-Step Evidence-Grounded Scientific Reasoning in Multimodal Agents
新基准和框架提升多模态AI推理和可靠性
作者PulseAugur 编辑部·[5 个来源]·
研究人员开发了新的基准和框架,以提高多模态AI智能体的可靠性和基于证据的推理能力。Sci-MMR是科学推理的基准测试,突显了当前模型在答案准确性和证据恢复之间存在的显著差距,并指出了证据获取和整合中的瓶颈。同时,CUSP提供了一种无需训练的方法来量化多智能体多模态系统中的集体不确定性,通过分析模型响应的分散性和冲突来提高可靠性。V-Retrver引入了一个智能体推理框架,该框架利用外部工具主动获取视觉证据,以提高多模态检索的准确性和可靠性。
AI
arXiv:2609.14823v1 Announce Type: new Abstract: Multimodal clinical decision-making requires reliable reasoning over heterogeneous evidence from electronic health records, medical images, and physiological signals. Existing models typically map these inputs directly to diagnoses …
arXiv cs.AI
TIER_1English(EN)·Jiaqiang Li, Yajie Yang, Zhiheng Xi, Jiadong Chen, Enyu Zhou, Senjie Jin, Yang Nan, Jiazheng Zhang, Han Wang, Yanxin Li, Dingwei Zhu, Bicheng Deng, Yuhui Wang, Xiang Zheng, Qi Zhang, Lei Bai, Xingjun Ma, Tao Gui·
arXiv:2609.11243v1 Announce Type: new Abstract: Autonomous research agents are increasingly expected to search the literature, analyze experimental evidence, and generate scientific hypotheses. These capabilities require multi-step evidence grounded reasoning that progressively a…
arXiv cs.AI
TIER_1English(EN)·Chung-En Johnny Yu, David Garcia, Brian Jalaian, Nathaniel D. Bastian·
arXiv:2609.05708v1 Announce Type: new Abstract: Aggregating heterogeneous vision-language models (VLMs) can improve multimodal reasoning, but neither an individual model's confidence nor that of the aggregated answer measures reliability at the system level. We present CUSP (Coll…
arXiv cs.MA (Multiagent)
TIER_1English(EN)·Nathaniel D. Bastian·
Aggregating heterogeneous vision-language models (VLMs) can improve multimodal reasoning, but neither an individual model's confidence nor that of the aggregated answer measures reliability at the system level. We present CUSP (Collective Uncertainty through Semantic Opinion Pool…
arXiv cs.CV
TIER_1English(EN)·Dongyang Chen, Chaoyang Wang, Dezhao Su, Xi Xiao, Zeyu Zhang, Jing Xiong, Qing Li, Yuzhang Shang, Shichao Kan·
arXiv:2602.06034v3 Announce Type: replace Abstract: Multimodal Large Language Models (MLLMs) have recently been applied to universal multimodal retrieval, where Chain-of-Thought (CoT) reasoning improves candidate reranking. However, existing approaches remain largely language-dri…