PulseAugur
实时 12:14:30
English(EN) SIVA-RL: Sensitivity-Invariance Visual Alignment for Multimodal Reinforcement Learning

SIVA-RL框架通过将预测与视觉证据联系起来,增强了多模态推理能力

研究人员推出了一种新颖的SIVA-RL框架,旨在通过确保视觉语言模型将其预测与视觉证据联系起来,来改进多模态强化学习。与依赖干预类型的先前方法不同,SIVA-RL使用样本级、结果条件化的监督来使模型行为与观察到的效果保持一致。这种方法与GRPO和DAPO骨干兼容,在九个多模态推理基准测试中显示出显著的改进,将视觉依赖推理提高了8.79个百分点,整体相对改进高达14.9%。 AI

影响 通过改进视觉语言模型中的视觉基础,增强了多模态推理能力。

排序理由 该集群包含一篇详细介绍多模态强化学习新框架的研究论文。

在 arXiv cs.CV 阅读 →

AI 生成摘要 · Google Gemini · 来自 3 个来源。 我们如何撰写摘要 →

SIVA-RL框架通过将预测与视觉证据联系起来,增强了多模态推理能力

报道来源 [3]

  1. Hugging Face Daily Papers TIER_1 English(EN) ·

    SIVA-RL: Sensitivity-Invariance Visual Alignment for Multimodal Reinforcement Learning

    Reinforcement learning with verifiable rewards (RLVR) drives multimodal reasoning, but answer-level correctness does not guarantee that a vision-language model grounds its predictions in visual evidence. Existing visual-intervention methods contrast policy behavior on original an…

  2. arXiv cs.CV TIER_1 English(EN) · Cheng Tang, Junzhi Ning, Min Cen, Wei Li, Xinyi Zeng, Pinxian Zeng, Rongbin Li, Qiming Zhu, Yuqiang Li, Junjun He, Yirong Chen, Ming Hu ·

    SIVA-RL:多模态强化学习的敏感性-不变性视觉对齐

    arXiv:2607.13931v1 Announce Type: new Abstract: Reinforcement learning with verifiable rewards (RLVR) drives multimodal reasoning, but answer-level correctness does not guarantee that a vision-language model grounds its predictions in visual evidence. Existing visual-intervention…

  3. arXiv cs.CV TIER_1 English(EN) · Ming Hu ·

    SIVA-RL:多模态强化学习的敏感性-不变性视觉对齐

    Reinforcement learning with verifiable rewards (RLVR) drives multimodal reasoning, but answer-level correctness does not guarantee that a vision-language model grounds its predictions in visual evidence. Existing visual-intervention methods contrast policy behavior on original an…