Cross-Scale Distillation

X-AuT framework progressively compresses speech LLM audio encoders

Researchers have developed X-AuT, a novel framework designed to progressively compress audio-encoder layers in speech large language models. This method aims to reduce inference costs without significantly sacrificing a…