English(EN) Would an LLM Match into a Residency? Uncertainty, Reasoning and Image Use of Open Language Models on the Spanish MIR Examination

开放语言模型在西班牙住院医师资格考试中接受测试

作者 PulseAugur 编辑部 · [1 个来源] · 2026-10-23 04:00

一篇新发表在arXiv上的研究探讨了开放语言模型在西班牙MIR住院医师资格考试中的能力。研究人员评估了四种参数量从80亿到270亿不等的模型，评估了它们的准确性、不确定性、推理能力和图像使用情况。参数量较大的模型表现出具有竞争力的性能，有可能排在前列，但它们的置信度与准确性并不总是相关。医学微调提高了置信度，但降低了整体准确性，并且模型给出正确答案的推理并不总是临床上合理的。此外，移除或更改提供的图像并未影响模型的性能。 AI

影响这项研究深入探讨了开放语言模型在高风险医疗环境中的实际应用和局限性，并指出了未来在推理和不确定性量化方面的发展方向。

排序理由发表在arXiv上的研究论文，评估了LLM在特定医学考试中的表现。[lever_c_demoted from research: ic=1 ai=1.0]

在 arXiv cs.CL 阅读 →

AI 生成摘要 · Google Gemini · 来自 1 个来源。我们如何撰写摘要 →

本文如何被排名

Signal score: 4 / 100; Composite score across the factors below. Higher = stronger signal that this story matters right now.
Newsworthiness bucket: Tool; 发表在arXiv上的研究论文，评估了LLM在特定医学考试中的表现。[lever_c_demoted from research: ic=1 ai=1.0]
Source corroboration: Single-source cluster; Only one publisher covered this so far. Single-source stories can still rank when the publisher is high-authority, but they lack cross-source corroboration.
Topics: paper, model release; Editorial topic classification. Feeds into how the story surfaces on /topic/<slug> hub pages and into the per-entity coverage mix.
AI-industry relevance: High; Clearly on-topic for AI-industry coverage.
Story freshness: Same-day; Cluster formed today. Ranking reflects the current source set at time of score.

完整方法见我们的编辑标准。

报道来源 [1]

arXiv cs.CL TIER_1 English(EN) · Miguel Fernandez-de-Retana, Unai Zulaika, Ruben Sanchez-Corcuera, Aritz Bilbao-Jayo, Aitor Almeida · 2026-10-23 04:00

Would an LLM Match into a Residency? Uncertainty, Reasoning and Image Use of Open Language Models on the Spanish MIR Examination

arXiv:2610.31586v1 Announce Type: new Abstract: Accuracy on medical examinations is common evidence offered for the clinical use of language models, yet a health system that intends to run an open model on its own hardware needs to know considerably more: whether the model recogn…

本文如何被排名

报道来源 [1]

Would an LLM Match into a Residency? Uncertainty, Reasoning and Image Use of Open Language Models on the Spanish MIR Examination

相关实体

相关话题