PulseAugur
实时 11:39:12

New SFT method aligns reinforcement learning with Boltzmann projection

Researchers have developed a new method called Reference-Sampled Boltzmann Projection (BOLT) for improving reinforcement learning with verifiable rewards. This technique aims to decouple rollout generation from the optimization process by using static supervised fine-tuning (SFT) on precomputed data. The BOLT procedure establishes a target-matched weighted SFT objective, which is shown to be equivalent to a KL-regularized RLVR optimizer. AI

影响 Introduces a novel technique for more efficient training of reinforcement learning models, potentially reducing computational bottlenecks.

排序理由 This is a research paper detailing a new method for reinforcement learning.

在 arXiv cs.LG 阅读 →

AI 生成摘要 · Google Gemini · 来自 2 个来源。 我们如何撰写摘要 →

New SFT method aligns reinforcement learning with Boltzmann projection

报道来源 [2]

  1. arXiv cs.LG TIER_1 English(EN) · Yao Shu, Chenxing Wei, Hongbin Lin, Shuang Qiu, Hui Xiong ·

    Reference-Sampled Boltzmann Projection for KL-Regularized RLVR: Target-Matched Weighted SFT, Finite One-Shot Gaps, and Policy Mirror Descent

    arXiv:2605.02469v1 Announce Type: new Abstract: Online reinforcement learning with verifiable rewards (RLVR) turns checkable outcomes into a scalable training signal, but it keeps rollout generation, verifier scoring, and reference-policy evaluations on the optimization path. Sta…

  2. arXiv cs.AI TIER_1 English(EN) · Hui Xiong ·

    Reference-Sampled Boltzmann Projection for KL-Regularized RLVR: Target-Matched Weighted SFT, Finite One-Shot Gaps, and Policy Mirror Descent

    Online reinforcement learning with verifiable rewards (RLVR) turns checkable outcomes into a scalable training signal, but it keeps rollout generation, verifier scoring, and reference-policy evaluations on the optimization path. Static weighted supervised fine-tuning (SFT) on pre…