Flexformer

Flexformer introduces learnable attention kernels for efficient Transformers

Researchers have introduced Flexformer, a novel linear Transformer architecture designed to overcome the quadratic complexity limitations of traditional Transformers. Flexformer achieves this by learning attention kerne…