Nicolas Anguita

New theory explains how pretraining shapes machine learning model fine-tuning

Researchers have developed a theoretical framework to explain how pretraining influences inductive bias during the fine-tuning of machine learning models. Their analysis, conducted on diagonal linear networks, identifie…