Alessio Quercia

New LoRA+ method balances model performance and knowledge retention

Researchers have introduced a new method called LoRA+ for fine-tuning large pre-trained models, aiming to improve the balance between task-specific performance and the retention of pre-trained knowledge. This approach f…