lapis lazuli

Lapis spiking attention mechanism reduces energy use in vision transformers

Researchers have introduced Lapis, a novel spiking attention mechanism designed for spiking vision transformers. This new approach scores token pairs based on the L1 distance between their query and key first-spike late…