Two new research papers introduce advanced post-training quantization (PTQ) techniques for Vision Transformers (ViTs) to improve efficiency on resource-constrained devices. MixFrag focuses on adaptive layer-wise precision assignment by estimating component fragility and formulating bit allocation as a knapsack problem, achieving competitive performance on ImageNet-1K and state-of-the-art results on COCO object detection. DopQ-ViT addresses performance degradation by aligning quantization with activation distributions and handling outliers, proposing a Tan Quantizer and a MAD-guided Optimal Scaling Factor that outperform previous PTQ methods on classification and detection tasks. AI
IMPACT These techniques could enable more efficient deployment of advanced Vision Transformer models on edge devices with limited computational resources.
RANK_REASON Two academic papers published on arXiv detailing new methods for post-training quantization of Vision Transformers.
- arXiv
- DopQ-ViT
- Hugging Face
- Lianwei Yang
- MAD-guided Optimal Scaling Factor
- Tan Quantizer
- Vision Transformers
- Vits
- COCO
- ImageNet-1K
- Kullback--Leibler
- MixFrag
AI-generated summary · Google Gemini · from 2 sources. How we write summaries →