Kan Extension Transformers

Kan Extension Transformers unify attention, diffusion, and self-conditioning

Researchers have introduced Kan Extension Transformers (KETs), a new framework that unifies various Transformer implementations under a categorical lens. KETs view Transformer layers as weighted structured extension ope…