Manufactoria 2022

New RL method NGU tackles 'Matthew Effect' in LLM training · 2 sources tracked

A new research paper introduces the "Matthew Effect in RL for LLMs," observing that reinforcement learning disproportionately benefits easy tasks for large language models, while hard tasks see minimal improvement. To a…