Data Efficient Image Transformers
PulseAugur coverage of Data Efficient Image Transformers — every cluster mentioning Data Efficient Image Transformers across labs, papers, and developer communities, ranked by signal.
3 day(s) with sentiment data
-
Deep learning models for breast cancer detection benchmarked for performance and emissions
A new paper benchmarks seven deep learning models for breast cancer detection, evaluating their performance and environmental impact. The study found that while EfficientNet and ResNet offer strong accuracy, they also p…
-
New APQF framework automates AI model compression with LLM guidance
Researchers have developed APQF, an automated framework designed to optimize deep neural networks for efficiency on edge devices. This system uses an agentic approach, guided by LLM planners and profiling data, to deter…
-
New IPPRO framework offers scale-invariant neural network pruning
Researchers have introduced IPPRO, a novel framework for neural network compression that addresses the limitations of magnitude-based pruning. By utilizing projective geometry, IPPRO defines a scale-invariant 'PROscore'…
-
New ToaSt framework boosts Vision Transformer efficiency
Researchers have developed a new framework called ToaSt designed to make Vision Transformers (ViTs) more computationally efficient. ToaSt decouples strategies for different parts of the ViT architecture, applying head-w…
-
New RAPID framework boosts Vision Transformer efficiency via layer-wise token merging
Researchers have developed RAPID, a novel framework designed to make Vision Transformers (ViTs) more computationally efficient. This method intelligently prunes and merges tokens based on their layer-specific characteri…
-
AI models' attention topologies mapped to human brain networks
Researchers have developed a novel method to compare the organizational properties of transformer-based AI models by mapping their attention topologies to human brain networks. This approach allows for modality-agnostic…
-
New algorithm enhances neural network compression with low-rank adaptation
Researchers have developed a new algorithm called GPTQ-intrinsic LoRA to improve the efficiency of compressing large neural networks. This method integrates low-rank correction directly into the quantization process, ai…
-
SnapViT enables elastic Vision Transformers without retraining
Researchers have developed SnapViT, a novel method for creating elastic Vision Transformers (ViTs) that can adapt to various computational budgets without requiring retraining. This post-pretraining structured pruning t…
-
New RBDC protocol slashes vision model training costs by 30%
Researchers have developed a new training protocol called RBDC to make training large vision models more resource-efficient. This method involves recursively coupling independently trained, narrower models in a paramete…
-
FAIR-Pruner framework enables adaptive layer-wise neural network pruning
Researchers have developed FAIR-Pruner, a new framework designed for automatic, layer-wise structured pruning of deep neural networks. This method adaptively allocates sparsity across network layers by using both remova…
-
AI model FusionCell predicts circuit performance using layout and topology
Researchers have developed FusionCell, a novel AI model designed to predict the performance of standard cells in digital circuits. This model uniquely integrates both layout geometry and netlist topology, overcoming lim…
-
New methods QFlash and ELSA boost Vision Transformer attention efficiency
Researchers have developed two new methods to improve the efficiency of attention mechanisms in vision transformers. QFlash focuses on enabling integer-only operations for FlashAttention, achieving significant speedups …