OPT-1.3B

PACZero enables PAC-private fine-tuning of language models with usable utility

Researchers have developed PACZero, a novel method for fine-tuning large language models that offers strong privacy guarantees. This approach utilizes sign quantization of gradients to achieve a privacy regime where mem…