DMX

New framework dMX optimizes LLM bit-widths for better efficiency

Researchers have developed dMX, a novel differentiable framework for optimizing the bit-width of floating-point formats in large language models. This method allows for learnable, per-layer bit-width assignments, moving…