Knowledge-to-Prompt

New self-distillation methods improve LLM performance without external teachers · 4 sources tracked

Researchers have introduced several novel self-distillation techniques for language models, aiming to improve performance without requiring external teachers or ground-truth labels. Activation-Conditioned Self-Distillat…