研究人员开发了 Robust-U1，一个旨在增强多模态大语言模型（MLLMs）在处理损坏视觉内容时鲁棒性的新框架。该方法使 MLLMs 能够自我修复损坏的图像，提高其理解和推理视觉信息的能力。该框架采用监督微调、双奖励强化学习和多模态推理的三阶段过程，在损坏基准测试中取得了最先进的性能。 AI
影响 增强了 MLLMs 对视觉损坏的鲁棒性，有望提高实际应用的可靠性。
排序理由 该集群包含一篇详细介绍 MLLMs 新框架的学术论文。
AI 生成摘要 · Google Gemini · 来自 2 个来源。 我们如何撰写摘要 →
arXiv:2606.08063v1 Announce Type: cross Abstract: Multimodal Large Language Models (MLLMs) have demonstrated remarkable success in visual understanding, yet their performance degrades significantly under real-world visual corruptions. While existing robustness enhancement approac…
Multimodal Large Language Models (MLLMs) have demonstrated remarkable success in visual understanding, yet their performance degrades significantly under real-world visual corruptions. While existing robustness enhancement approaches exist, they are limited: black-box feature ali…