English(EN) Where Do Vision Language Models Fail at 3D Reasoning?

新基准揭示视觉语言模型在3D推理方面存在困难

作者 PulseAugur 编辑部 · [1 个来源] · 2026-10-31 04:00

一个名为BedBench的新基准已被开发出来，用于评估视觉语言模型的3D推理能力。该基准揭示了模型在一致使用物体属性方面存在显著的不足，尤其是在颜色计数方面，人类准确率超过93%，而最佳模型的准确率仅为7.2%。即使经过有针对性的微调，模型在可靠应用恢复的属性方面仍然存在困难，这表明在识别和持续利用信息之间存在差距。对Qwen3.5-27B的探测显示，虽然它可以恢复精确的每种颜色计数，但其生成的答案很少反映这些信息。 AI

影响突出了当前视觉语言模型在3D推理方面的关键局限性，需要新的评估方法和模型改进。

排序理由介绍用于评估AI能力的新型基准的新学术论文。[lever_c_demoted from research: ic=1 ai=1.0]

在 arXiv cs.AI 阅读 →

AI 生成摘要 · Google Gemini · 来自 1 个来源。我们如何撰写摘要 →

本文如何被排名

Signal score: 0 / 100; Composite score across the factors below. Higher = stronger signal that this story matters right now.
Newsworthiness bucket: Tool; 介绍用于评估AI能力的新型基准的新学术论文。[lever_c_demoted from research: ic=1 ai=1.0]
Source corroboration: Single-source cluster; Only one publisher covered this so far. Single-source stories can still rank when the publisher is high-authority, but they lack cross-source corroboration.
Topics: paper, model release; Editorial topic classification. Feeds into how the story surfaces on /topic/<slug> hub pages and into the per-entity coverage mix.
AI-industry relevance: High; Clearly on-topic for AI-industry coverage.
Story freshness: 12 days old; Aged out of breaking-news scoring windows; ranking reflects the durable signal from the full source set.

完整方法见我们的编辑标准。

报道来源 [1]

arXiv cs.AI TIER_1 English(EN) · Khai Le-Duc, Nguyen Kim Hai Bui, An Ngo, Nam D. Hoang, Yueqi Song, Jiarui Liu, Thai Quoc Hoang, Fang Wu, Chris Ngo, Terry Jingchen Zhang, Mona T. Diab, Ran Xu, Silvio Savarese, Xiao-Ming Wu · 2026-10-31 04:00

视觉语言模型在3D推理方面存在哪些不足？

arXiv:2610.39639v1 Announce Type: cross Abstract: Vision-language models can get individual judgments right while struggling to recover and consistently use the exact properties of a 3D object. To characterize this gap, we introduce BedBench, a controlled benchmark of thirteen pr…

本文如何被排名

报道来源 [1]

视觉语言模型在3D推理方面存在哪些不足？

相关实体

相关话题