PulseAugur
实时 15:56:29
English(EN) World Action Verifier: Self-Improving World Models via Forward-Inverse Asymmetry

通过逆向动力学预测改进用于世界建模的VLM

研究人员正在探索改进视觉语言模型(VLM)在世界建模方面的预测能力的方法。一个关键挑战是VLM在正向动力学预测(根据动作生成未来状态)方面存在困难,但在逆向动力学预测(描述状态之间的动作)方面更擅长。这种不对称性正被用于通过弱监督学习(来自标注数据)和推理时验证等技术来增强VLM的性能。这些方法旨在为具身AI应用创建更强大、更准确的世界模型,其中一些方法在图像编辑和策略评估方面显示出与最先进模型相媲美的结果。 AI

影响 世界模型的进步可能带来更强大的具身AI代理和用于训练的改进模拟环境。

排序理由 多篇学术论文提出了世界模型和视觉语言模型的新方法和基准。

在 arXiv cs.AI 阅读 →

AI 生成摘要 · Google Gemini · 来自 4 个来源。 我们如何撰写摘要 →

通过逆向动力学预测改进用于世界建模的VLM

报道来源 [4]

  1. arXiv cs.AI TIER_1 English(EN) · Yifu Qiu, Yftah Ziser, Anna Korhonen, Shay B. Cohen, Edoardo M. Ponti ·

    VLMs 能预测未来状态吗?从逆向动力学引导世界模型

    arXiv:2506.06006v3 Announce Type: replace-cross Abstract: Can unified vision-language models (VLMs) perform forward dynamics prediction (FDP), i.e., predicting the future state (in image form) given the previous observation and an action (in language form)? We find that VLMs stru…

  2. arXiv cs.AI TIER_1 English(EN) · Yuejiang Liu, Fan Feng, Lingjing Kong, Weifeng Lu, Jinzhou Tang, Kun Zhang, Kevin Murphy, Chelsea Finn, Yilun Du ·

    World Action Verifier:通过前向-逆向不对称实现自改进的世界模型

    arXiv:2604.01985v2 Announce Type: replace-cross Abstract: General-purpose world models promise scalable policy evaluation, optimization, and planning, yet achieving the required level of robustness remains challenging. Unlike policy learning which primarily focuses on optimal act…

  3. arXiv cs.CV TIER_1 English(EN) · Ao Liang, Lingdong Kong, Tianyi Yan, Hongsi Liu, Wesley Yang, Ziqi Huang, Wei Yin, Jialong Zuo, Yixuan Hu, Dekai Zhu, Dongyue Lu, Youquan Liu, Guangfeng Jiang, Linfeng Li, Xiangtai Li, Long Zhuo, Lai Xing Ng, Benoit R. Cottereau, Changxin Gao, Liang Pan,… ·

    WorldLens:对真实世界驾驶世界模型的全谱评估

    arXiv:2512.10958v2 Announce Type: replace Abstract: Generative world models are reshaping embodied AI, enabling agents to synthesize realistic 4D driving environments that look convincing but often fail physically or behaviorally. Despite rapid progress, the field still lacks a u…

  4. arXiv cs.CV TIER_1 English(EN) · An Dinh Vuong, Tuan Van Vo, Abdullah Sohail, Haoran Ding, Liang Ma, Xiaodan Liang, Anqing Duan, Ivan Laptev, Ian Reid ·

    World2Act:基于世界模型动态的潜在动作后训练

    arXiv:2603.10422v2 Announce Type: replace Abstract: World Models (WMs) offer a promising mechanism for post-training Vision-Language-Action (VLA) policies by providing dynamics priors that improve generalization under task and scene variation. However, most WM-based post-training…