Space Filling Curves

VIOLIN enhances Vision Transformers with spatial priors for limited data

Researchers have developed VIOLIN, a novel masked attention mechanism for Vision Transformers (ViTs) that enhances their ability to process images with limited data or smaller model capacities. By encoding spatial struc…