ViT-AdaLA

ViT-AdaLA framework adapts Vision Transformers with linear attention

Researchers have introduced ViT-AdaLA, a new framework designed to adapt existing Vision Transformers (ViTs) for more efficient linear attention mechanisms. This method addresses the computational cost of training linea…