PTQTP

New quantization method enables efficient serving of large MoE models

Researchers have developed a novel quantization technique called Tied Trit-Planes (PTQTP) that constrains LLM weight matrices to a uniform nine-level quantizer. This method allows for a lossless folding of two trit plan…