近期研究探讨了视觉-语言-动作(VLA)模型的进展,重点在于提高其在复杂任务和现实世界应用中的能力。论文讨论了多模态预训练的扩展定律,引入了用于历史一致性的AnachroBench和用于忠实图像理解的ContraSense等新基准,并开发了用于长时域任务的RB-VLA和用于高并发分布式强化学习的D-VLA等新架构。这些努力旨在提高VLA模型在机器人操作、物理动力学推理和泛化等领域的性能,解决当前模型的局限性。
AI
arXiv:2611.22351v1 Announce Type: new Abstract: Vision-language models (VLMs) have emerged as central foundation models combining multimodal perception with text comprehension. While VLMs are traditionally built via late fusion by continued pre-training an off-the-shelf language …
Existing Large Vision-Language Model benchmarks primarily evaluate visual understanding in general everyday scenarios, leaving historical consistency with a specified era and country largely underexplored. To address this gap, we propose AnachroBench, a controlled discriminative …
arXiv:2602.20659v3 Announce Type: replace Abstract: Vision-language-action models must enable agents to execute long-horizon tasks under partial observability. However, most existing approaches remain observation-driven, relying on short context windows or repeated queries to vis…
arXiv:2605.13276v3 Announce Type: replace Abstract: The rapid evolution of Embodied AI has enabled Vision-Language-Action (VLA) models to excel in multimodal perception and task execution. However, applying Reinforcement Learning (RL) to these massive models in large-scale distri…
arXiv:2511.21542v3 Announce Type: replace-cross Abstract: Vision-Language-Action (VLA) models offer a unified framework for robotic manipulation by integrating visual perception, language understanding, and control generation. However, existing VLA systems still struggle to gener…
arXiv:2601.01547v3 Announce Type: replace-cross Abstract: Spatial intelligence is central to embodied cognition, yet contemporary AI systems still struggle to reason about physical interactions in open-world human environments. Despite strong performance on controlled benchmarks,…
arXiv:2611.18372v1 Announce Type: cross Abstract: Vision-language-action (VLA) models adapt web-pretrained vision-language models to output robot actions, so that web knowledge carries over to physical control. In under 4 years the field has moved from RT-2, the first VLA, to ope…
Frontier Vision-Language Models (VLMs) such as GPT-6 Astra have demonstrated remarkable capabilities in robot control, suggesting that broad pretraining provides knowledge valuable for physical action. Yet most Vision-Language-Action (VLA) policies still rely on much smaller VLM …
arXiv cs.AI
TIER_1English(EN)·Wen-Han Hsieh, Ken Jiankun Zheng, Chia-Chien Chen, David M. Chan, Trevor Darrell·
arXiv:2611.14834v1 Announce Type: cross Abstract: Vision-language-action (VLA) models have made significant progress in general-purpose robotic manipulation. However, sampled action sequences can be ineffective, while evaluating alternatives with computationally expensive verifie…
arXiv cs.CV
TIER_1English(EN)·Ling Lin, Heng Su, Xiangzeng Liu, Yang Bai, Congcong Zhu, Jingrun Chen·
arXiv:2611.22360v1 Announce Type: new Abstract: Multimodal large language models (MLLMs) have achieved impressive performance on a wide range of vision-language tasks. However, it remains unclear whether their predictions are grounded in the visual content itself or are largely d…
arXiv:2611.22564v1 Announce Type: new Abstract: Vision-language models (VLMs) are widely used as zero-shot image quality assessors, yet their good-vs-poor answers agree only moderately with human opinion. We ask whether these models fail to see quality or fail to say it. Layer-wi…
arXiv cs.CV
TIER_1English(EN)·Qixuan Wu (School of Artificial Intelligence, Beihang University, Beijing, China), Xiaole Yang (School of Software, Beihang University, Beijing, China), Yuguang Yang (School of Electronic and Information Engineering, Beihang University, Beijing, China), …·
arXiv:2611.20971v2 Announce Type: replace Abstract: Pretrained video representations provide rich temporal information for robotic manipulation, yet effectively integrating them into existing vision-language-action (VLA) policies remains challenging. We present Flow-Aware Visual …