Angelo Porrello

New method combines linear and non-linear fine-tuning for LLMs

Researchers have developed a method to combine the benefits of linear and non-linear fine-tuning for large language models. Their approach distills the desirable properties of linearized models, which are good for task …