Zhang Jianhao

New NADS framework tackles catastrophic forgetting in LLM fine-tuning

Researchers have introduced NADS, a new framework designed to combat catastrophic forgetting during the fine-tuning of large language models. This method utilizes a 'navigator' model to identify and score synthetic data…