Gaotang Li

New SFT objectives outperform NLL for capable LLMs

Researchers have explored alternative objectives for supervised fine-tuning (SFT) of large language models, moving beyond the standard negative log likelihood (NLL). Their study, involving extensive experiments across v…