momentum smoothing

New CPR method for LLMs combats catastrophic forgetting in domain adaptation

Researchers have developed a new method called Critical-Point Routing (CPR) to address catastrophic forgetting in large language models (LLMs) during domain adaptation. CPR decouples general and domain-specific capabili…