SPRKD

New SPRKD method enhances knowledge distillation for deep neural networks

Researchers have developed a new knowledge distillation technique called SPRKD, which reframes the process from simple output replication to using teachers as proxies for optimization curvature and domain knowledge. SPR…