Full Information Activation Supervision (FIAS)

New method squeezes LLM weights by 10x with minimal accuracy loss

Researchers have developed Squeeze10-LLM, a novel post-training quantization framework designed to significantly reduce the size of large language models. This method achieves an average of 1.6 bits per weight by quanti…