Irene Trigueros-Lorca

Knowledge distillation can improve CNNs in data-scarce settings

Researchers have investigated knowledge distillation (KD) for training smaller, more efficient Convolutional Neural Networks (CNNs) by transferring knowledge from larger teacher models. While typically applied at the fi…