Mikolaj Walczak

ShatterQuant enables block-wise mixed-precision for transformer hardware

Researchers have developed ShatterQuant, a novel framework for mixed-precision quantization in neural networks that allows for independent bit-width assignments to different blocks within a single tensor. This approach …