PulseAugur
实时 17:04:16
English(EN) Learning to Move Before Learning to Do: Task-Agnostic pretraining for VLAs

新的TAP框架减少了VLA模型对专家数据的需求

研究人员引入了一个名为任务无关预训练(TAP)的新框架,旨在克服视觉-语言-动作(VLA)模型中的数据稀缺瓶颈。TAP采用两阶段方法:首先,它利用无标签交互数据通过自监督逆动力学目标学习可迁移的运动技能,然后用最少的专家语言数据来巩固这些技能。这种方法显著减少了对昂贵专家演示的需求,在标记数据量少几个数量级的情况下,达到了与在数百万专家轨迹上训练的模型相当的性能。 AI

影响 通过减少对昂贵、专家标记数据的依赖,这种方法可以显著加速具身AI系统的开发和部署。

排序理由 该集群包含一篇详细介绍新研究框架和方法的学术论文。

在 arXiv cs.AI 阅读 →

AI 生成摘要 · Google Gemini · 来自 3 个来源。 我们如何撰写摘要 →

新的TAP框架减少了VLA模型对专家数据的需求

报道来源 [3]

  1. arXiv cs.AI TIER_1 English(EN) · Junhao Shi, Siyin Wang, Xiaopeng Yu, Li Ji, Jingjing Gong, Xipeng Qiu ·

    Learning to Move Before Learning to Do: Task-Agnostic pretraining for VLAs

    arXiv:2607.02466v1 Announce Type: cross Abstract: Vision-Language-Action (VLA) models are fundamentally bottlenecked by the scarcity of expert demonstrations -- triplets of observations, instructions, and actions that are costly to collect at scale. We argue that this bottleneck …

  2. arXiv cs.AI TIER_1 English(EN) · Xipeng Qiu ·

    Learning to Move Before Learning to Do: Task-Agnostic pretraining for VLAs

    Vision-Language-Action (VLA) models are fundamentally bottlenecked by the scarcity of expert demonstrations -- triplets of observations, instructions, and actions that are costly to collect at scale. We argue that this bottleneck stems from conflating two distinct learning object…

  3. Hugging Face Daily Papers TIER_1 English(EN) ·

    Learning to Move Before Learning to Do: Task-Agnostic pretraining for VLAs

    Task-Agnostic Pretraining framework trains robotic models using self-supervised inverse dynamics on unlabeled data followed by lightweight language grounding, achieving superior performance with minimal expert demonstrations.