aditiPatodiya/quantcheck-audit

Quantized LLMs on Hugging Face, Ollama found non-functional

A recent paper highlights that quantized large language models (LLMs) available on public registries can be non-functional due to uncalibrated quantization processes. Researchers tested hundreds of GGUF files from the O…