ENTITY
Adversarial Distillation
Adversarial Distillation
PulseAugur coverage of Adversarial Distillation — every cluster mentioning Adversarial Distillation across labs, papers, and developer communities, ranked by signal.
Total · 30d
0
2 over 90d
Releases · 30d
0
0 over 90d
Papers · 30d
0
2 over 90d
TIER MIX · 90D
TOPICS
RECENT · PAGE 1/1 · 2 TOTAL
-
New research refines black-box distillation for LLMs · 2 sources tracked
Two new research papers explore advancements in black-box on-policy distillation, a technique used to train smaller student language models from larger, API-accessible teacher models. The first paper introduces "persist…
-
New theory explains why robust AI teachers can harm student models
Researchers have identified a key mechanism behind the inconsistent success of adversarial distillation, a technique used to improve student model robustness. They found that when a robust teacher model provides confide…