CLS token
PulseAugur coverage of CLS token — every cluster mentioning CLS token across labs, papers, and developer communities, ranked by signal.
-
New method visualizes feature evolution in Vision Transformers
Researchers have developed a new method to visualize the training process of Vision Transformers (ViTs) by examining feature evolution across network depth and training time. Using Sparse Autoencoders (SAEs), they can i…
-
Foundation Model Patch Tokens Enhance Kidney Tumor and Cyst Detection
Researchers have developed DINOv3-MIL, a novel approach for detecting kidney tumors and cysts using foundation vision models. This method leverages patch tokens from DINOv3 ViT-H/16 features and compares three aggregati…
-
DuoAD framework enhances training-free anomaly detection using ViT [CLS] token
Researchers have developed DuoAD, a novel framework for training-free few-shot anomaly detection that effectively utilizes the global contextual information from Vision Transformers (ViTs). The method leverages the dual…
-
New framework probes Vision Transformer geometry and representation dynamics
Researchers have introduced the Transformer Geometry Observatory (TGO), a framework designed to explore the representational geometry of Vision Transformers (ViTs). The initial installment, TGO-I, specifically examines …