RL is even more information inefficient than you thought

LLM capabilities primarily stem from imitative learning, not RL, analysis suggests

A recent analysis argues that the capabilities of large language models (LLMs) are primarily derived from imitative learning, such as pre-training and supervised fine-tuning, rather than reinforcement learning (RL). Whi…