GPTAQ
PulseAugur coverage of GPTAQ — every cluster mentioning GPTAQ across labs, papers, and developer communities, ranked by signal.
1 day(s) with sentiment data
-
New methods refine LLM quantization for reduced size and cost · 2 sources tracked
Two new research papers propose novel methods for post-training quantization (PTQ) of large language models, aiming to reduce their size and computational requirements. The first paper, "From Sweep to Seam: Interleaved …
-
KronQ framework enhances LLM quantization using gradient covariance
Researchers have introduced KronQ, a novel post-training quantization (PTQ) framework designed to compress large language models (LLMs) more effectively. Unlike previous methods that rely solely on activation statistics…
-
OpenPangu LLM quantization on Ascend NPUs shows 8-bit is lossless, 4-bit degrades 1B model
A new study investigates the effectiveness of various post-training quantization methods for the OpenPangu large language models when deployed on Ascend NPUs. Researchers found that 8-bit weight-only quantization is nea…