GaugeQuant

GaugeQuant optimizes LLM quantization by learning from model symmetries

Researchers have developed GaugeQuant, a novel method for optimizing the quantization of large language models (LLMs) by leveraging their internal symmetries. This technique introduces a LogSumExp term to the training l…