Évita Muzic

New ViT token reduction schedule boosts out-of-distribution accuracy

Researchers have developed a new token reduction schedule for Vision Transformers (ViTs) that improves performance under distribution shift. This "late-concentrated" schedule, which removes more tokens in later layers, …