LLVQ

CoS-VQ method enhances LLM efficiency with joint index-scale optimization

Researchers have introduced CoS-VQ, a novel vector quantization method designed to improve the efficiency of large language models (LLMs). This technique optimizes low-bit weight quantization by jointly refining codewor…