New method overlaps ML computation and communication for faster multi-GPU training

Researchers have developed a method to improve the efficiency of multi-GPU machine learning training by overlapping computation and communication phases. The technique uses shared-memory allocation to manage computation kernel residency, ensuring enough on-chip resources are available for communication kernels. By assigning higher priority to communication streams, the approach effectively reduces total execution time by up to 25.5 percent across various NVIDIA and AMD GPUs without altering vendor libraries. AI

IMPACT Improves efficiency of distributed ML training, potentially reducing costs and accelerating research cycles.

RANK_REASON Academic paper detailing a novel method for optimizing ML workloads. [lever_c_demoted from research: ic=1 ai=1.0]

Read on arXiv cs.AI →

• A100
• AMD
• MI250X
• NVIDIA

• paper
• infra

AI-generated summary · Google Gemini · from 1 sources. How we write summaries →