Quantized LLMs

Quantized LLMs face 'alignment collapse,' erasing safety guardrails

Post-training quantization (PTQ) of large language models (LLMs) can lead to a phenomenon called "alignment collapse," where safety guardrails like RLHF and DPO are silently erased when models are compressed to lower bi…