JACTUS

Compress Then Adapt? No, Do It Together via Task-aware Union of Subspaces

Researchers have introduced JACTUS, a novel framework that unifies parameter-efficient fine-tuning (PEFT) and low-rank compression for adapting large pretrained models. Unlike sequential methods, JACTUS jointly optimize…