Utility-Diversity Aware Online Batch Selection

New methods optimize LLM fine-tuning for efficiency and data quality · 2 sources tracked

Two research papers introduce novel methods for optimizing the supervised fine-tuning (SFT) of large language models (LLMs). The first, "Online Dynamic Batching" (ODB), addresses the challenge of variable sample process…