Frontier VLMs fail medical VQA tests due to poor grounding and confusion

作者 PulseAugur 编辑部 · [3 个来源] · 2026-04-30 11:11

A new paper evaluates five leading vision-language models (VLMs) on their trustworthiness for medical visual question answering (VQA). The study found significant limitations in the models' ability to accurately localize anatomical targets and a tendency for laterality confusion, with the best model achieving only 0.23 mean IoU. Integrating localization into a pipeline further degraded performance, highlighting grounding as a key bottleneck. While domain adaptation shows promise for improving VQA accuracy, the perception and trustworthiness issues remain. AI

影响 Identifies critical perception and grounding failures in frontier VLMs for medical applications, suggesting domain adaptation is needed to improve trustworthiness.

排序理由 Academic paper evaluating frontier models on a specific task.

在 arXiv cs.AI 阅读 →

AI 生成摘要 · Google Gemini · 来自 3 个来源。我们如何撰写摘要 →

报道来源 [3]

arXiv cs.AI TIER_1 English(EN) · Xupeng Chen, Binbin Shi, Chenqian Le, Qifu Yin, Lang Lin, Haowei Ni, Ran Gong, Panfeng Li · 2026-05-01 04:00

Auditing Frontier Vision-Language Models for Trustworthy Medical VQA: Grounding Failures, Format Collapse, and Domain Adaptation

arXiv:2604.27720v1 Announce Type: new Abstract: Deploying vision-language models (VLMs) in clinical settings demands auditable behavior under realistic failure conditions, yet the failure landscape of frontier VLMs on specialized medical inputs is poorly characterized. We audit f…
arXiv cs.AI TIER_1 English(EN) · Panfeng Li · 2026-04-30 11:11

Auditing Frontier Vision-Language Models for Trustworthy Medical VQA: Grounding Failures, Format Collapse, and Domain Adaptation

Deploying vision-language models (VLMs) in clinical settings demands auditable behavior under realistic failure conditions, yet the failure landscape of frontier VLMs on specialized medical inputs is poorly characterized. We audit five recent frontier and grounding-aware VLMs (Ge…
Hugging Face Daily Papers TIER_1 English(EN) · 2026-04-30 11:11

Auditing Frontier Vision-Language Models for Trustworthy Medical VQA: Grounding Failures, Format Collapse, and Domain Adaptation

Deploying vision-language models (VLMs) in clinical settings demands auditable behavior under realistic failure conditions, yet the failure landscape of frontier VLMs on specialized medical inputs is poorly characterized. We audit five recent frontier and grounding-aware VLMs (Ge…

报道来源 [3]

Auditing Frontier Vision-Language Models for Trustworthy Medical VQA: Grounding Failures, Format Collapse, and Domain Adaptation

Auditing Frontier Vision-Language Models for Trustworthy Medical VQA: Grounding Failures, Format Collapse, and Domain Adaptation

Auditing Frontier Vision-Language Models for Trustworthy Medical VQA: Grounding Failures, Format Collapse, and Domain Adaptation

相关实体

相关话题