English(EN)Volumetric Radiology AI in the Era of Multimodal Large Language Models
新的MLLM通过3D上下文和不确定性推理增强放射学AI · 跟踪3个来源
作者PulseAugur 编辑部·[4 个来源]·
研究人员正在推进用于放射学的多模态大语言模型(MLLM),超越简单的图像分析,实现复杂推理。一篇论文介绍了一个框架,该框架解决了容积放射学数据与当前MLLM之间的表示不匹配问题,强调了需要能够保留和整合3D空间上下文的系统。另一种方法侧重于不确定性感知重新审视推理,模型动态地重新检查不确定的区域以完善解释,在基准数据集上取得了最先进的结果。第三项开发介绍了RadFound,一个专门在海量放射学数据集上训练的开源MLLM,在各种成像模态和任务中展示了专家级性能,并引入了一个新的基准RadVLBench,用于全面评估。
AI
arXiv:2608.20549v1 Announce Type: new Abstract: Advances in multimodal large language models (MLLMs) are extending radiological artificial intelligence (AI) beyond task-specific image analysis toward multimodal understanding and reasoning. Volumetric radiology, however, presents …
arXiv:2608.25251v1 Announce Type: new Abstract: Medical vision-language models (VLMs) can appear reliable in-domain while failing when acquisition domain, paired supervision, or evaluation protocol changes. We study this failure mode as a representation-level blind spot relevant …
arXiv cs.CV
TIER_1English(EN)·Yucheng Chen, Yang Yu, Jiazhou Zhou, Yufei Shi, Yongying Lan, Yichi Zhang, Liyi Li, Si Yong Yeo·
arXiv:2608.22217v1 Announce Type: new Abstract: Radiologists generate diagnostic reports through iterative and selective revisiting of suspicious regions to refine their interpretations. Recent multimodal large language models (MLLMs) for radiology report generation (RRG) have sh…
arXiv:2409.16183v2 Announce Type: replace Abstract: Radiology is a vital and complex component of modern clinical workflow and covers many tasks. Recently, vision-language (VL) foundation models in medicine have shown potential in processing multimodal information, offering a uni…