Researchers have developed a knowledge distillation technique to create a compact model for grading diabetic retinopathy from retinal fundus images. This method successfully distilled knowledge from larger teacher models like ResNet-50, MobileNetV3-Large, and Swin Transformer-Tiny into a smaller MobileNetV3-Small student model. The resulting student model achieved a quadratic weighted kappa of 0.9093 and a macro-F1 score of 0.6851, representing an 18.07x parameter reduction compared to the Swin Transformer-Tiny teacher while maintaining competitive performance. AI
IMPACT Enables deployment of advanced medical imaging AI on resource-constrained devices, potentially improving accessibility to diagnostic tools.
RANK_REASON The cluster contains an academic paper detailing a novel method for model compression and its application to a specific medical imaging task. [lever_c_demoted from research: ic=1 ai=1.0]
- APTOS 2019
- Hugging Face
- Macro F1
- MobileNetV3-Large
- MobileNetV3-Small
- quadratic weighted kappa
- ResNet-50
- Swin Transformer-Tiny
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →