New RAFT framework refines domain fine-tuning, reduces model forgetting

Researchers have introduced RAFT, a novel two-stage framework designed to improve domain-specific fine-tuning of language models while mitigating performance degradation on general tasks. RAFT addresses issues like supervision-compatibility and trajectory-preservation by first refining domain-specific data through self-conditioned rewriting and semantic filtering. It then employs an adaptive distillation process that uses the original model's behavior on generated trajectories as soft targets, conditioned on the refined answers. AI

IMPACT This research offers a method to improve domain-specific AI models without sacrificing general capabilities, potentially leading to more robust and versatile AI applications.

RANK_REASON This is a research paper detailing a new method for fine-tuning language models. [lever_c_demoted from research: ic=1 ai=1.0]

Read on arXiv cs.AI →

• arXiv
• IFEval
• MS-Bench
• RAFT

• paper
• model release

AI-generated summary · Google Gemini · from 1 sources. How we write summaries →