SuffixDecoding

NgramRL accelerates LLM training with rollout-aware n-gram speculative decoding

Researchers have developed NgramRL, a novel method to accelerate reinforcement learning (RL) post-training for large language models. This technique addresses the significant cost of autoregressive rollout generation, w…