ENTITY
all-gather
all-gather
PulseAugur coverage of all-gather — every cluster mentioning all-gather across labs, papers, and developer communities, ranked by signal.
Total · 30d
1
2 over 90d
Releases · 30d
0
0 over 90d
Papers · 30d
1
2 over 90d
TIER MIX · 90D
TOPICS
SENTIMENT · 30D
1 day(s) with sentiment data
RECENT · PAGE 1/1 · 2 TOTAL
-
SwiftQK optimizes LLM training with efficient tensor parallelism
Researchers have developed SwiftQK, a new method for optimizing Query-Key Normalization (QK-Norm) in large-language models trained with Tensor Parallelism. This technique significantly reduces the communication overhead…
-
New techniques ZipCCL and FlashOverlap accelerate LLM training by optimizing communication
Researchers have developed ZipCCL, a lossless compression library designed to accelerate the distributed training of large language models by addressing communication bottlenecks. The library utilizes novel techniques l…