Jiacheng Liu

MoE-Prism framework enhances LLM serving with elastic expert routing

Researchers have developed MoE-Prism, a framework designed to enhance the efficiency of Mixture-of-Experts (MoE) models in serving large language models (LLMs). This system allows for request-level compute elasticity by…