Gustavo Voltani von Atzingen

New distillation recipe creates CPU-deployable LLM safety classifiers

Researchers have developed a novel knowledge distillation technique to create smaller, more efficient safety classification models for large language models. These distilled models, trained on a carefully curated datase…