dense architectures

Library of Layers (LoL) dynamically orders transformer blocks at runtime

Researchers have introduced Library of Layers (LoL), a novel architecture that dynamically orders transformer blocks during inference. This approach allows for adaptive computation tailored to specific tasks, enabling p…