UniDecouple

New research tackles catastrophic forgetting in LLMs with novel tuning and regularization methods · 6 sources tracked

Researchers are exploring new methods to address catastrophic forgetting in large language models (LLMs) during continual learning. One approach, Subspace Tuning (SST), restricts weight updates to specific subspaces to …