Nccl
PulseAugur coverage of Nccl — every cluster mentioning Nccl across labs, papers, and developer communities, ranked by signal.
3 day(s) with sentiment data
-
New HSAP framework enhances LLM training efficiency for hybrid-context models
Researchers have introduced HSAP, a Hierarchical Sequence-aware Parallelism framework designed to improve the efficiency of training large language models. This new approach addresses challenges in handling hybrid-conte…
-
Together AI releases open-source Parallel Kernel Builder for LLM inference
Together AI has released Parallel Kernel Builder (PKB), an open-source tool designed to optimize inference performance for large language models. PKB can identify and generate novel kernels, such as those for NeMo vocab…
-
LLMs struggle to generate multi-GPU kernels, researchers find
Researchers at Together have found that while large language models can efficiently generate single-GPU kernels, they struggle significantly with multi-GPU kernel generation. These models perform poorly when asked to cr…
-
Frontier LLMs struggle with multi-GPU kernel generation, new benchmark reveals
A new benchmark called ParallelKernelBench (PKB) has been developed to evaluate the ability of frontier large language models to generate efficient multi-GPU kernels. Testing models like GPT-5.5, Gemini 3 Pro, and Opus …
-
User seeks advice on optimizing dual-GPU inference with llama.cpp
A user on the r/LocalLLaMA subreddit is seeking advice on optimizing performance with an asymmetric dual-GPU setup. They have a 3080 Ti with 12GB VRAM and a 3080 with 20GB VRAM, and are experiencing significant speed dr…
-
New OptCC algorithm minimizes AllReduce slowdown from network failures
Researchers have developed OptCC, a new algorithm designed to improve the efficiency of AllReduce operations in large-scale GPU clusters, particularly when network failures occur. This algorithm approaches theoretical l…
-
Developer details verl RL framework internals and NCCL bug
A developer detailed their experience working with ByteDance's verl framework for RL post-training, including its internal workings and the challenges of forking the project. The write-up covers the framework's orchestr…
-
New framework HetCCL boosts LLM training on mixed-hardware clusters
Researchers have developed HetCCL, a new framework designed to improve collective communication efficiency in heterogeneous computing clusters used for training large language models. This framework addresses the limita…
-
Trillion-parameter AI models challenge Kubernetes orchestration
Running trillion-parameter AI models within Kubernetes clusters presents significant challenges beyond standard container orchestration. These massive models require distributed systems approaches, where a single 'repli…
-
PyTorch tutorial simplifies distributed AI model inference
This article explains distributed inference techniques for large AI models using PyTorch. It details how to implement Data Parallelism (DP), Tensor Parallelism (TP), and Pipeline Parallelism (PP) with minimal code. The …
-
eBPF GPU agent enables LLM-driven cluster performance investigations
A new eBPF GPU agent has been developed to pinpoint performance bottlenecks in large-scale AI training clusters. This agent moves beyond host-level diagnostics to provide cluster-wide insights, identifying specific rank…