Pume Tuchinda

Stronger teachers don't always yield better students in VLM distillation

A new arXiv paper challenges the conventional wisdom that larger, more capable "teacher" models consistently produce better "student" models in knowledge distillation for vision-language tasks. Researchers found that ex…