Niclas Popp

New data augmentation method improves knowledge distillation for smaller AI models

Researchers have developed a novel data augmentation strategy for knowledge distillation, aiming to improve the performance of smaller student networks when trained on limited data. This method uses a diffusion-based ap…