John O Bryan Mathematics Competition

Knowledge distillation boosts compact AI model accuracy on math reasoning tasks

Researchers have explored knowledge distillation to improve the performance of smaller AI models on complex reasoning tasks. They used a large reasoning model, DeepSeek-R1, to train a more compact Qwen2.5-7B model on hi…