Quantization-Aware Training
PulseAugur coverage of Quantization-Aware Training — every cluster mentioning Quantization-Aware Training across labs, papers, and developer communities, ranked by signal.
4 day(s) with sentiment data
-
New QAH method recovers performance of compressed 4-bit LLMs
Researchers have developed a new method called Quantization-Aware Healing (QAH) to recover the performance of large language models that have been compressed and quantized to 4-bit precision. Unlike traditional Quantiza…
-
New QUASAR methods enhance LLM accuracy in low-bit quantization
Two new research papers introduce QUASAR, a novel method for improving the accuracy of quantized large language models. The first paper focuses on a training-free post-training quantization approach that addresses issue…
-
QUASAR method improves LLM quantization by lowering loss floor
Researchers have developed QUASAR, a novel quantization-aware training (QAT) method designed to improve the performance of large language models at lower precision. QUASAR addresses a key challenge in QAT where the loss…
-
New SQuaT framework enhances self-supervised knowledge distillation for low-bit models
Researchers have developed SQuaT, a novel framework for self-supervised knowledge distillation that addresses limitations in existing methods when combining quantization-aware training with distillation. SQuaT theoretic…
-
New QATMA framework tackles low-bit quantization challenges in open-vocabulary object detection
Researchers have developed QATMA, a novel framework for Quantization-Aware Training designed specifically for Open-Vocabulary Object Detection (OVOD) models. This approach addresses the degradation in both cross-modal a…
-
New GoodQ method uses generative models for zero-shot object detector quantization
Researchers have developed GoodQ, a new pipeline for Zero-Shot Quantization-Aware Training (ZSQ-OD) that leverages off-the-shelf generative models to create training datasets. This method addresses challenges such as de…
-
New CAGE method boosts accuracy in AI model quantization
Researchers have introduced CAGE (Curvature-Aware Gradient Estimation), a novel method for quantization-aware training (QAT) that aims to close the accuracy gap between quantized and natively trained models. CAGE enhanc…
-
Google Releases Gemma 4 Models with Quantization-Aware Training
Google has released new checkpoints for its Gemma 4 family of models, utilizing Quantization-Aware Training (QAT). This method trains the models to be more accurate when their weights are compressed to very low bit-widt…
-
New methods boost LLM efficiency with advanced 2-bit and adaptive quantization
Researchers have developed new techniques to improve the efficiency of large language models (LLMs) through advanced quantization methods. One approach, SPEAR, focuses on adaptive recovery after quantization, reducing t…
-
Reddit discusses QAT model quantization compatibility
A discussion on Reddit explores the effectiveness of using alternative quantization methods with Quantization Aware Training (QAT) models. The core question is whether QAT, designed to emulate inference-time quantizatio…
-
Gemma 4 QAT models show faster speeds, less VRAM, same quality
A user benchmarked Google's Gemma 4 models, comparing standard quantization with quantization-aware training (QAT) versions on an AMD 7900 XTX GPU. The results indicate that QAT versions offer significant speedups and r…
-
Quantization-aware training improves LLM efficiency for low-resource hardware
Quantization-aware training (QAT) is a technique used to improve the performance of quantized neural networks. It involves simulating the effects of quantization during the training process, which helps the model adapt …
-
New QAT method bridges training-deployment gap for mobile image enhancement
Researchers have developed a new image enhancement model designed to overcome the quality degradation that typically occurs when models are converted to lower-precision formats for mobile devices. The proposed method ut…