Wikitext2
PulseAugur coverage of Wikitext2 — every cluster mentioning Wikitext2 across labs, papers, and developer communities, ranked by signal.
1 day(s) with sentiment data
-
New research explores advanced LLM quantization techniques for efficiency
Several new research papers explore advanced techniques for quantizing large language models (LLMs) to improve efficiency for deployment. REAL-Q introduces a dynamic gradient descent method to minimize end-to-end KL div…
-
New method prunes MoE language models using generic text corpora
Researchers have developed a new method called Generic TB-Coverage for pruning sparsely activated Mixture-of-Experts (MoE) language models. This technique addresses the challenge of removing redundant experts without re…
-
New MoE Pruning Method Uses Generic Data to Preserve Expert Utility
Researchers have developed a new method called Generic TB-Coverage for pruning sparsely activated Mixture-of-Experts (MoE) language models. This approach uses generic text corpora like WikiText2 and C4 for calibration, …
-
New methods tackle LLM quantization for improved efficiency and accuracy
Researchers have developed several new methods to improve the efficiency of large language models (LLMs) through quantization. OSAQ focuses on suppressing weight outliers using a low-rank Hessian property for accurate l…