New im2win convolution method boosts GPU performance and memory efficiency

Researchers have developed an enhanced version of the im2win convolution method, designed for greater memory efficiency and performance on GPUs. This updated method supports full precision on CUDA cores and half precision on Tensor Cores, incorporating optimizations like zig-zag memory access and asynchronous data movement. Benchmarks across twelve CNN tasks show significant improvements, with the new im2win achieving up to 2.8x higher TFLOPS than its CUDA-only version and outperforming standard cuDNN and GEMM-based convolutions in both speed and memory usage. AI

IMPACT Enhances computational efficiency for deep learning models, potentially accelerating training and inference on GPUs.

RANK_REASON Academic paper detailing a new method for optimizing deep learning computations on GPUs. [lever_c_demoted from research: ic=1 ai=1.0]

Read on arXiv cs.CV →

• CNN
• Cublas
• CUDA
• cuDNN: Efficient Primitives for Deep Learning
• GEMM
• graphics processing unit
• im2win
• Tensor Cores

• paper
• infra

AI-generated summary · Google Gemini · from 1 sources. How we write summaries →