scientific question-answering

Research: RL better preserves LLM circuits than SFT, reducing catastrophic forgetting

A new research paper explores the phenomenon of catastrophic forgetting in large language models, specifically comparing reinforcement learning (RL) and supervised fine-tuning (SFT). The study found that while SFT adapt…