Sunan Zou

UltraSketchLLM achieves sub-1-bit LLM compression with hardware optimization

Researchers have developed UltraSketchLLM, a novel method for compressing large language models (LLMs) to sub-1-bit per weight. This technique utilizes data sketching to significantly reduce GPU memory requirements, ach…