TorchTitan
PulseAugur coverage of TorchTitan — every cluster mentioning TorchTitan across labs, papers, and developer communities, ranked by signal.
3 day(s) with sentiment data
-
Prime Intellect boosts MoE training speed with fused backward pass kernel
Prime Intellect has enhanced DeepSeek's Mega MoE kernel by adding a fused, overlapping backward pass, making it suitable for training Mixture-of-Experts (MoE) models. This new kernel, Prime Mega MoE, significantly speed…
-
AWS enables Qwen3 LLM training on Trainium with TorchTitan framework
AWS is enabling developers to train the Qwen3 large language model on its Trainium chips using the TorchTitan framework. This integration allows for flexible training, including pre-training from scratch or fine-tuning …
-
Google open-sources TorchTPU, a native PyTorch backend for Cloud TPUs
Google has released TorchTPU, an open-source PyTorch backend designed for its Cloud TPUs. Developed in collaboration with Meta's PyTorch team and announced at PyTorch Conference 2026, TorchTPU allows PyTorch code to run…
-
New SCOUT framework detects failures in LLM pre-training
Researchers have developed SCOUT, a new framework designed to pinpoint failures during large language model (LLM) pre-training. SCOUT operates by establishing a strict majority consensus among equivalent replicas to ide…