HuggingFaceTB

Tutorial shows LFM2 fine-tuning with QLoRA and DPO

This tutorial demonstrates how to fine-tune the LFM2 model using QLoRA and Direct Preference Optimization (DPO) on Google Colab. It covers loading the base LFM2 model with 4-bit quantization, preparing a dataset for sup…