Fractional-Fourier Mixture of Experts

FRAME introduces adaptive domain learning for parameter-efficient fine-tuning

Researchers have introduced FRAME, a novel parameter-efficient fine-tuning (PEFT) method that learns the optimal domain for weight updates. Unlike existing methods that fix updates to either the spatial or Fourier domai…