Verl
PulseAugur coverage of Verl — every cluster mentioning Verl across labs, papers, and developer communities, ranked by signal.
2 day(s) with sentiment data
-
Coding agents struggle with complex AI infrastructure tasks, achieving 38.9% success
InfraDev, a project evaluating coding agents, tested their ability to perform complex AI infrastructure tasks. The agents were challenged with 36 multi-file, multi-GPU changes derived from projects like Megatron-LM, vLL…
-
MXFP8 Reinforcement Learning on Blackwell: Speed, Consistency, and Failure Modes Explored
A new research paper explores the use of MXFP8 precision for end-to-end reinforcement learning (RL) with large language models on NVIDIA's Blackwell platform. The study implements and measures this approach using variou…
-
Study: Few RL methods from arXiv papers adopted by open-source frameworks
A study analyzing seven open-source reinforcement learning (RL) training frameworks found that a low percentage of proposed RL methods from arXiv papers are integrated into these frameworks. Out of 1,598 papers proposin…
-
New LLM research tackles unlearning, acceleration, serving, and evaluation
Multiple research papers explore advancements in large language model (LLM) capabilities and efficiency. "Nullify" introduces a training-free method for unlearning sensitive information from LLMs without compromising ut…
-
New RL Research Reveals Critical Flaw in Reward Shaping and Filtering
A new research paper highlights a critical flaw in group-relative reinforcement learning (RL) methods, specifically concerning the 'filter metric' when used with shaped rewards. The study demonstrates that if the filter…
-
AI model evaluations can be misleading due to interface censoring
A new research paper highlights a phenomenon called "Interface-Induced Trajectory Censoring" where the interface used to evaluate AI models can incorrectly report zero tool usage, even when the model is generating valid…
-
New framework streamlines RL training for LLM tool-use agents
Researchers have developed MCP-Universe RL (MCP-U RL), an open-source framework designed to streamline the training of large language model (LLM) agents that utilize tools. This framework addresses two key challenges: e…
-
Provenir tackles LLM training failures: reward hacking, contamination, irreproducibility
A new open-source project called Provenir aims to address three critical but often invisible failures in modern LLM training: reward hacking, evaluation contamination, and irreproducibility. Reward hacking occurs when m…
-
New DigenRL framework accelerates diffusion generative LLMs with disaggregated RL · 3 sources tracked
Researchers have developed DigenRL, a disaggregated reinforcement learning framework designed to enhance the efficiency of diffusion-based generative large language models. This new framework addresses limitations in ex…
-
Developer details verl RL framework internals and NCCL bug
A developer detailed their experience working with ByteDance's verl framework for RL post-training, including its internal workings and the challenges of forking the project. The write-up covers the framework's orchestr…
-
Open-source pipeline trains Lean 4 theorem provers, sets new benchmarks · 1 source tracked
Hugging Face has released Kimina-Prover-RL, an open-source training pipeline for formal theorem proving in the Lean 4 programming language. This pipeline, inspired by DeepSeek-R1 and utilizing the GRPO reinforcement lea…