ShamAN-Q

New ShamAN-Q method slashes LLM weights to sub-1-bit

Researchers have developed ShamAN-Q, a novel sub-1-bit post-training quantization method for large language models. This technique enhances NanoQuant by incorporating a dense curvature metric derived from the Shampoo op…