teacher-generated supervision

Small LLMs improved for legal summarization via sequence-level distillation

Researchers have developed a sequence-level distillation method to enhance the ability of small Large Language Models (LLMs) to summarize long legal opinions. This annotation-free technique, which uses a long-context te…