Jelena Markovic-Voronov

New pruning technique optimizes MoE models; recurrent models show promise for clinical NLP

Researchers have developed a new method called OptEP for pruning Mixture-of-Experts (MoE) language models, which significantly reduces the number of expert parameters that need to be stored without sacrificing performan…