MoEGen

MoEGen framework offers instance-adaptive LoRA generation

Researchers have introduced MoEGen, a novel framework for parameter-efficient fine-tuning (PEFT) that utilizes a mixture-of-experts (MoE) approach. Unlike previous methods that store multiple LoRA experts, MoEGen repres…