Scarcity-Aware Rewards

New RL framework tackles bias in multi-instruction LLM training

Researchers have identified an exploration bias in reinforcement learning (RL) for training large language models (LLMs) to follow multiple instructions. This bias occurs because models tend to favor easier instructions…