PulseAugur
实时 13:27:09
English(EN) Hierarchical Advantage Weighting for Online RL Fine-Tuning of VLAs from Sparse Episode Outcomes

新HABC方法提升视觉语言智能体强化学习微调效果

研究人员引入了分层优势加权行为克隆(HABC)方法,以改进视觉语言智能体(VLAs)的在线强化学习。HABC通过分离可行性和效率目标,并使用状态自适应门来平衡它们,从而解决了强化学习微调中稀疏、二元结果的挑战。该方法还纳入了干预感知信用分配,以防止从外部策略执行的片段中进行不正确的学习。在真实机器人任务上的实验表明,与标准的监督微调基线相比,成功率有了显著提高。 AI

影响 这项研究为提高复杂机器人任务强化学习的效率和有效性提供了一种新颖的方法。

排序理由 该集群包含一篇详细介绍强化学习新方法的学术论文。

在 arXiv cs.LG 阅读 →

AI 生成摘要 · Google Gemini · 来自 3 个来源。 我们如何撰写摘要 →

报道来源 [3]

  1. arXiv cs.LG TIER_1 English(EN) · Tongyan Fang, Siyuan Huang, Naiyu Fang, Ganlong Zhao, Zhongjin Luo, Jianbo Liu, Xiaogang Wang, Ying Dong, Hongsheng Li ·

    Hierarchical Advantage Weighting for Online RL Fine-Tuning of VLAs from Sparse Episode Outcomes

    arXiv:2606.17043v1 Announce Type: cross Abstract: When pretrained VLA policies are fine-tuned through online RL, each rollout episode produces only a single binary outcome (success or failure), yet the actor update requires per-transition supervision. Existing approaches commonly…

  2. arXiv cs.LG TIER_1 English(EN) · Hongsheng Li ·

    Hierarchical Advantage Weighting for Online RL Fine-Tuning of VLAs from Sparse Episode Outcomes

    When pretrained VLA policies are fine-tuned through online RL, each rollout episode produces only a single binary outcome (success or failure), yet the actor update requires per-transition supervision. Existing approaches commonly reduce this sparse outcome to a single scalar rew…

  3. Hugging Face Daily Papers TIER_1 English(EN) ·

    Hierarchical Advantage Weighting for Online RL Fine-Tuning of VLAs from Sparse Episode Outcomes

    Hierarchical Advantage-Weighted Behavior Cloning (HABC) addresses sparse reward challenges in robot learning by separately optimizing viability and efficiency objectives through adaptive critic heads and intervention-aware credit assignment, significantly improving success rates …