group-mean baseline subtraction

Research reveals LoRA dynamics in SFT vs RL, proposes tailored configurations

A new research paper published on arXiv details the spectral and subspace dynamics of Low-Rank Adaptation (LoRA) during supervised fine-tuning (SFT) and reinforcement learning (RL). The study found that RL concentrates …