LoRA-SFT

New research reveals reproducible signature of SFT in LLM activation geometry

A new research paper explores how supervised fine-tuning (SFT) leaves a distinct and reproducible mark on the internal activation geometry of large language models. The study found that rerunning SFT on models like Qwen…