FedProc

FlipGate tool measures per-item answer flips in quantized LLMs

A new tool called FlipGate has been developed to evaluate the per-item answer consistency of quantized large language models, going beyond traditional accuracy metrics. FlipGate measures how often a quantized model flip…