Qianli Wang

Quantization impacts LLM factual recall, with varied effects across models and methods

A new paper investigates how quantization, a technique used to compress large language models, affects their ability to recall factual knowledge. Researchers found that while quantization generally leads to some informa…