CSULoRA

CSULoRA method enhances LLM safety without sacrificing utility

Researchers have developed CSULoRA, a new post-hoc method to correct low-rank adaptation (LoRA) adapters in large language models. This technique addresses the issue where fine-tuning data, even in small amounts, can co…