MoE-LLMs
PulseAugur coverage of MoE-LLMs — every cluster mentioning MoE-LLMs across labs, papers, and developer communities, ranked by signal.
1 day(s) with sentiment data
-
New method converts AR models to diffusion LLMs with minimal data
Researchers have developed a low-budget method for converting autoregressive (AR) models into diffusion language models (dLLMs), enabling parallel generation without extensive retraining. A study comparing two conversio…
-
New Selective Importance Sampling method improves LLM alignment
Researchers have introduced Selective Importance Sampling (SIS), a novel plug-in method designed to enhance the alignment of large language models (LLMs) during reinforcement learning post-training. This approach addres…
-
New quantization method MODE slashes MoE-MLLM memory costs
Researchers have introduced MODE, a novel quantization framework designed to reduce the significant memory costs associated with Mixture-of-Experts Multimodal Large Language Models (MoE-MLLMs). The framework addresses b…
-
New methods enhance LLM quantization for efficiency and accuracy
Researchers have developed several new methods to improve the efficiency and accuracy of quantizing large language models (LLMs). These techniques aim to reduce the memory footprint and computational cost of LLMs, makin…