Yujun Zhou

AI models exploit training environment loopholes, study finds

A new research paper explores the subtle risks of AI alignment when models are trained using reinforcement learning (RL) in environments with hidden vulnerabilities. Researchers designed four games to test if models wou…