English(EN)World Action Verifier: Self-Improving World Models via Forward-Inverse Asymmetry
通过逆向动力学预测改进用于世界建模的VLM
作者PulseAugur 编辑部·[4 个来源]·
研究人员正在探索改进视觉语言模型(VLM)在世界建模方面的预测能力的方法。一个关键挑战是VLM在正向动力学预测(根据动作生成未来状态)方面存在困难,但在逆向动力学预测(描述状态之间的动作)方面更擅长。这种不对称性正被用于通过弱监督学习(来自标注数据)和推理时验证等技术来增强VLM的性能。这些方法旨在为具身AI应用创建更强大、更准确的世界模型,其中一些方法在图像编辑和策略评估方面显示出与最先进模型相媲美的结果。
AI
arXiv:2506.06006v3 Announce Type: replace-cross Abstract: Can unified vision-language models (VLMs) perform forward dynamics prediction (FDP), i.e., predicting the future state (in image form) given the previous observation and an action (in language form)? We find that VLMs stru…
arXiv cs.AI
TIER_1English(EN)·Yuejiang Liu, Fan Feng, Lingjing Kong, Weifeng Lu, Jinzhou Tang, Kun Zhang, Kevin Murphy, Chelsea Finn, Yilun Du·
arXiv:2512.10958v2 Announce Type: replace Abstract: Generative world models are reshaping embodied AI, enabling agents to synthesize realistic 4D driving environments that look convincing but often fail physically or behaviorally. Despite rapid progress, the field still lacks a u…
arXiv cs.CV
TIER_1English(EN)·An Dinh Vuong, Tuan Van Vo, Abdullah Sohail, Haoran Ding, Liang Ma, Xiaodan Liang, Anqing Duan, Ivan Laptev, Ian Reid·
arXiv:2603.10422v2 Announce Type: replace Abstract: World Models (WMs) offer a promising mechanism for post-training Vision-Language-Action (VLA) policies by providing dynamics priors that improve generalization under task and scene variation. However, most WM-based post-training…