Jeonghye Kim

Self-distillation can harm LLM reasoning by suppressing uncertainty, study finds

A new research paper explores how self-distillation, a technique used to improve large language models (LLMs), can sometimes degrade their mathematical reasoning capabilities. The study, published on arXiv, found that t…