Mixture-of-Experts LLMs
PulseAugur coverage of Mixture-of-Experts LLMs — every cluster mentioning Mixture-of-Experts LLMs across labs, papers, and developer communities, ranked by signal.
2 day(s) with sentiment data
-
New method uses cross-lingual gaps to interpret MoE LLMs
Researchers have developed a novel framework to interpret Mixture-of-Experts (MoE) Large Language Models (LLMs) by leveraging cross-lingual inconsistencies. This method identifies specific model components, or "experts,…
-
Personalizing Mixture-of-Experts LLMs for better control and understanding
Researchers have proposed a method to personalize Mixture-of-Experts (MoE) Large Language Models (LLMs) by leveraging their sparse routing capabilities. This approach aims to reduce polysemanticity, a problem in dense L…
-
New framework RASET probes safety in Mixture-of-Experts LLMs
Researchers have introduced RASET, a novel framework for evaluating safety in Mixture-of-Experts (MoE) Large Language Models. Contrary to the intuition that safety is managed by dedicated refusal experts, this work demo…