DeiT-S
PulseAugur coverage of DeiT-S — every cluster mentioning DeiT-S across labs, papers, and developer communities, ranked by signal.
-
Foveated Dynamic Transformer mimics human vision for efficiency and robustness
Researchers have developed a Foveated Dynamic Transformer (FDT) inspired by the human visual system's foveated sampling and eye movements. This architecture dynamically selects tokens to process, enhancing efficiency an…
-
New depth pruning method boosts Vision Transformer efficiency
Researchers have developed a new method called HetDPT to improve depth pruning for Vision Transformers (ViTs). This approach accounts for the heterogeneity between different layers, which was a limitation in previous de…
-
Fusion framework unifies Vision Transformer adaptation for efficiency
Researchers have developed Fusion, a novel framework designed to enhance the efficiency of Vision Transformers (ViTs) by unifying sequential token adaptation techniques. This framework coordinates token merging, early e…
-
Vision Transformers reduce demographic bias in face anti-spoofing systems
A new study published on arXiv investigates the impact of Vision Transformer (ViT) architectures on demographic bias in face presentation attack detection (PAD) systems. The research compares ViTs against convolutional …