40 and 100 Gigabit Ethernet
PulseAugur coverage of 40 and 100 Gigabit Ethernet — every cluster mentioning 40 and 100 Gigabit Ethernet across labs, papers, and developer communities, ranked by signal.
2 day(s) with sentiment data
-
Clos Network Architecture: Cost and Selection Framework for AI Inference Clusters
The Clos (or Fat-Tree) network architecture is a popular choice for large-scale AI inference clusters due to its scalability and high bandwidth. This article analyzes the cost components of Clos networks, including swit…
-
New SAOD Technique Compresses 744B LLM from 1.5TB to Under 100GB
A new technique called Session-Adaptive Orthogonal Distillation (SAOD) has been proposed to significantly compress large language models. This method aims to reduce the size of a 744 billion parameter model, which curre…
-
SkewAdam optimizer slashes MoE training memory by 97%
A new optimizer called SkewAdam has been developed to significantly reduce the memory required for training Mixture-of-Experts (MoE) models. This optimizer achieves a 97.4% reduction in optimizer state memory by employi…