Researchers have evaluated the performance of a self-supervised vision transformer encoder for Earth observation tasks when run on commodity x86 hardware. The study found that INT8 quantization had a negligible impact on accuracy, with micro-mAP changing by only +0.0006. This quantization significantly reduced CPU latency and energy consumption across various x86 nodes, with improvements of up to 1.45x in latency on CPUs without AVX2. The optimal hardware for inference shifted from integrated GPUs to CPUs as the CPU's capabilities improved. AI
IMPACT Quantization techniques can significantly reduce inference costs for AI models on edge devices, enabling wider deployment.
RANK_REASON Academic paper detailing hardware inference performance of a self-supervised model. [lever_c_demoted from research: ic=1 ai=1.0]
- AVX2
- central processing unit
- Christian Sanchez-Leon
- graphics processing unit
- half-precision floating-point format
- Int8
- single-precision floating-point format
- Viện Khoa học An toàn và Vệ sinh lao động
- x86
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →