head knowledge

LLM compression harms knowledge retention and masks bias, study finds

A new research paper published on arXiv details the asymmetric harms that can arise from compressing large language models (LLMs). The study, which evaluated three LLMs across eleven compression methods, found that comp…