Post-Binarization Activation Robustness (PBAR)

New methods drastically shrink LLM size and boost inference speed

Researchers have developed two novel methods to significantly reduce the size and computational cost of large language models (LLMs) without substantial performance loss. Squeeze10-LLM employs a staged mixed-precision q…