SpIn-ViT

SpIn-ViT framework enhances Vision Transformer interpretability and accuracy

Researchers have developed SpIn-ViT, a novel framework that integrates a Vision Transformer (ViT) with a Sparse Autoencoder (SAE) for enhanced interpretability and performance. Unlike previous methods that applied SAEs …