Qwen MoE
PulseAugur coverage of Qwen MoE — every cluster mentioning Qwen MoE across labs, papers, and developer communities, ranked by signal.
1 day(s) with sentiment data
-
New algorithm Spectra optimizes optical switches for AI training
A new paper proposes Spectra, an algorithm designed to optimize the scheduling of parallel optical circuit switches (OCSes) for AI training. This method addresses the challenge of managing time-varying traffic demands a…
-
HEAPr algorithm precisely prunes LLM experts, cutting memory needs
Researchers have developed HEAPr, a new pruning algorithm designed to reduce the memory footprint of Mixture-of-Experts (MoE) large language models. Unlike previous methods that prune entire experts, HEAPr breaks down e…
-
New framework enhances MoE LLMs on noisy analog hardware
Researchers have introduced ROMER, a post-training calibration framework designed to enhance the robustness of Mixture-of-Experts (MoE) Large Language Models (LLMs) when deployed on analog Compute-in-Memory (CIM) system…