Lucas Bandarkar

New method uses cross-lingual gaps to interpret MoE LLMs

Researchers have developed a novel framework to interpret Mixture-of-Experts (MoE) Large Language Models (LLMs) by leveraging cross-lingual inconsistencies. This method identifies specific model components, or "experts,…