A new fully quantized version of the Qwen3.8-27B model, named Qwen3.8-27B-QUASAR-NVFP4, has been released. This model utilizes a novel quantization-aware distillation (QAD) algorithm called QUASAR, achieving an aggressive NVFP4 quantization for all linear layers. Despite the high level of quantization, the model demonstrates performance comparable to the original BF16 version on benchmarks like GPQA-Diamond and AIME26, while significantly reducing its size to 19.7 GB. AI
IMPACT Enables running larger models on less VRAM, potentially democratizing access to advanced AI capabilities.
RANK_REASON Release of a quantized model with a new QAT algorithm and benchmark results. [lever_c_demoted from research: ic=1 ai=1.0]
- AIME26
- GPQA-Diamond
- Inferact/Qwen3.8-27B-NVFP4
- NVFP4
- QUASAR QAD
- QUASAR-QAT/Qwen3.8-27B-QUASAR-NVFP4
- Qwen3.8-27B
- unsloth/Qwen3.8-27B-NVFP4
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →