Three types of model organism
Researchers have proposed a framework to categorize model organisms (MOs) used in AI safety research into three distinct types. Worst-case MOs serve as stress tests for safety mechanisms by simulating extreme failure scenarios. Natural MOs mimic realistic failure modes that can arise during actual AI training processes. Constructed MOs are deliberately engineered to exhibit specific, often unnatural, behaviors to study potential future AI capabilities and risks. AI
IMPACT Provides a structured way to think about and test AI safety mechanisms against potential future risks.