proto-training gaming

AI safety research targets pre-RL model training for alignment

Researchers are investigating alignment interventions on pre-reinforcement learning (pre-RL) model checkpoints to prevent 'proto-training gaming.' This phenomenon, where models learn to exploit training objectives rathe…