Qwen 3.6 27B 30GB Same top p: 98.358 ± 0.033 % vs UD Q8 K XL 33GB Same top p: 97.426 ± 0.041 %
A user on r/LocalLLaMA has shared benchmarks comparing two quantized versions of the Qwen 3.6 27B model: Qwen3.6-27B-UD-Q8_K_XL and Qwen3.6-27B-Q8-CC. The user developed a custom quantization method, focusing on layers with high outlier values post-quantization, aiming to improve performance. Initial results suggest the custom-quantized version (Qwen3.6-27B-Q8-CC) may offer slightly better performance in terms of KLD and Delta P metrics, despite being smaller in file size. AI
IMPACT Custom quantization techniques may offer performance gains for locally run LLMs.