Markov Chain Routing of Transformer Layers

MACRO framework optimizes LLM layer routing without weight changes

Researchers have introduced MACRO, a novel framework for optimizing Transformer layer execution in large language models. MACRO enables dynamic layer routing without altering model weights, modeling the routing process …