E8-QAT

New E8-QAT method achieves efficient 2-bit LLM quantization

Researchers have developed E8-QAT, a novel 2-bit quantization-aware training framework that utilizes the E8 lattice as an implicit codebook. This method efficiently quantizes weight groups through arithmetic projection,…