Kostas Alexis

Researchers distill Vision Transformers for robust learning from distorted images

Researchers have developed a new knowledge distillation framework to improve the robustness of vision models against image distortions. The method uses an asymmetric approach where a teacher model processes clean images…