Ke Li

HEAPr algorithm precisely prunes LLM experts, cutting memory needs

Researchers have developed HEAPr, a new pruning algorithm designed to reduce the memory footprint of Mixture-of-Experts (MoE) large language models. Unlike previous methods that prune entire experts, HEAPr breaks down e…