Knights and Knaves

New self-distillation methods enhance LLM training and continual learning

Researchers have developed new methods for improving the training of language models, particularly focusing on self-distillation techniques. One approach, VASPO, enhances policy optimization by integrating privileged in…