Q5_K

ExTernD technique offers near-bf16 accuracy for LLMs at lower bit-widths · 4 sources tracked

Researchers have developed ExTernD, a novel post-training quantization technique for Large Language Models (LLMs). This method decomposes LLM weight matrices into ternary factors and a diagonal scaling vector, allowing …