KL-regularized projection

New CIG-SFT method enhances LLM generalization in post-training

Researchers have introduced CIG-SFT, a novel framework for supervised fine-tuning (SFT) of large language models. This method uses an information-theoretic approach to estimate the conditional information carried by eac…