研究人员开发了VIABLE，一个旨在评估视觉语言模型（VLMs）在作为视障辅助（VIA）任务裁判时的可靠性的新基准。他们的研究测试了七个不同的VLM裁判，发现当前模型在很大程度上不可靠，即使是表现最好的GPT-5.4，诊断准确性也有限。为了改进这一点，他们提出了VIA-Judge-Agent，一个通过视觉证据提取和结构化工作流程来增强裁判能力的工具，从而提高准确性和用户偏好响应。 AI
影响 凸显了当前视觉语言模型在专业辅助任务中的不可靠性，需要新的评估方法和工具。
排序理由 该集群包含一篇介绍AI任务新基准和评估框架的学术论文。
AI 生成摘要 · Google Gemini · 来自 2 个来源。 我们如何撰写摘要 →
arXiv:2605.31351v1 Announce Type: new Abstract: AI-based Visually Impaired Assistance (VIA) remains challenging, largely due to the high cost of human evaluation. The VLM-as-a-Judge paradigm may offer a promising alternative, although it has mostly been studied in general domains…
AI-based Visually Impaired Assistance (VIA) remains challenging, largely due to the high cost of human evaluation. The VLM-as-a-Judge paradigm may offer a promising alternative, although it has mostly been studied in general domains. We therefore ask whether such judges can be tr…