MoE-LLMs
PulseAugur coverage of MoE-LLMs — every cluster mentioning MoE-LLMs across labs, papers, and developer communities, ranked by signal.
2 day(s) with sentiment data
-
New Selective Importance Sampling method improves LLM alignment
Researchers have introduced Selective Importance Sampling (SIS), a novel plug-in method designed to enhance the alignment of large language models (LLMs) during reinforcement learning post-training. This approach addres…
-
New quantization method MODE slashes MoE-MLLM memory costs
Researchers have introduced MODE, a novel quantization framework designed to reduce the significant memory costs associated with Mixture-of-Experts Multimodal Large Language Models (MoE-MLLMs). The framework addresses b…
-
New methods enhance LLM quantization for efficiency and accuracy
Researchers have developed several new methods to improve the efficiency and accuracy of quantizing large language models (LLMs). These techniques aim to reduce the memory footprint and computational cost of LLMs, makin…