ML accelerators

LLM quantization paradox resolved by new scaling techniques

A new arXiv paper investigates the paradox where smaller block sizes in LLM quantization can degrade model quality. Researchers found this is not an inherent limitation but stems from how statistical clustering interact…