router matrix

New framework RARE improves MoE language model steering

Researchers have developed RARE, a new framework for steering Mixture-of-Experts (MoE) language models, which decouples representation steering from expert routing. This approach projects behavioral perturbations onto t…