Parameter Space Orthogonality

New JANUS framework mitigates catastrophic forgetting in AI models

Researchers have developed a novel post-hoc framework called JANUS to address the stability-plasticity dilemma in fine-tuning foundation models. This method aims to mitigate catastrophic forgetting by ensuring Parameter…