DeiT-Small
PulseAugur coverage of DeiT-Small — every cluster mentioning DeiT-Small across labs, papers, and developer communities, ranked by signal.
2 day(s) with sentiment data
-
MDTransformer: Novel photonic accelerator design boosts efficiency
Researchers have developed MDTransformer, a novel hardware-software co-design for photonic transformer accelerators. This system utilizes mode-division optical dataflow and inverse-designed photonic components to perfor…
-
CLEAR-MoE converts frozen Vision Transformers to sparse MoE models
Researchers have developed CLEAR-MoE, a novel post-training method to transform frozen Vision Transformers (ViTs) into sparse Mixture-of-Experts (MoE) models without altering the original backbone weights. This techniqu…
-
Adaptive Hebbian Routing enhances few-shot Vision Transformer performance
Researchers have developed an Adaptive Hebbian Routing method for few-shot Vision Transformers to improve image recognition from limited data. This approach uses a lightweight MLP router to dynamically control Hebbian m…
-
Hebbian Fast Weights enhance Vision Transformers for few-shot character recognition
Researchers have developed a new approach to few-shot character recognition by integrating Hebbian Fast-Weight (HFW) modules into Vision Transformer architectures. This method aims to mimic biological neural systems' ab…