Greedy Coordinate Diffusion

New geometric framework predicts AI alignment collapse during fine-tuning

Researchers have developed a new geometric framework to understand the fragility of alignment in language models during fine-tuning. Their analysis reveals that even seemingly benign tasks can systematically break safet…