MedCalc

New Anchored Learning framework stabilizes LLM fine-tuning, cuts catastrophic forgetting

Researchers have developed a new framework called Anchored Learning to mitigate catastrophic forgetting in large language models during supervised fine-tuning. This method explicitly controls distributional updates by u…