AuroSFT

AuroSFT framework improves multi-task fine-tuning by managing adapter states

Researchers have introduced AuroSFT, a new framework for multi-task fine-tuning that efficiently manages adapter states instead of full model checkpoints. This approach freezes the pretrained backbone and trains only in…