accordion

Accordion model offers flexible inference depth via layer looping

Researchers have developed Accordion, a novel mixture-of-experts model designed for flexible inference across various computational budgets. By employing fixed-prefix layer looping, Accordion supports five distinct infe…