ADMM-Q

New ADMM-Q algorithm enhances LLM quantization, reducing perplexity

Researchers have developed ADMM-Q, a new algorithm designed to improve post-training quantization for large language models. This method utilizes a combinatorial variant of the Alternating Direction Method of Multiplier…