AllGather

New T-CCL library boosts multi-GPU AI model performance with TMA

Researchers have developed T-CCL, a new collective communication library designed for efficient multi-GPU execution in large transformer models. T-CCL leverages the Tensor Memory Accelerator (TMA) to offload data moveme…