transformer engine
PulseAugur coverage of transformer engine — every cluster mentioning transformer engine across labs, papers, and developer communities, ranked by signal.
2 day(s) with sentiment data
-
MXFP8 Reinforcement Learning on Blackwell: Speed, Consistency, and Failure Modes Explored
A new research paper explores the use of MXFP8 precision for end-to-end reinforcement learning (RL) with large language models on NVIDIA's Blackwell platform. The study implements and measures this approach using variou…
-
MXFP8 Reinforcement Learning for LLMs: Gains, Pains, and Correctness
A new paper explores the use of MXFP8 precision for reinforcement learning (RL) in large language models, aiming to reduce computational costs. The research implements end-to-end MXFP8 RL on B200 GPUs using Qwen models …
-
New framework miniTE enables stable low-bit reinforcement learning for LLMs
Researchers have developed miniTE, a framework designed to enable stable low-bit reinforcement learning for large language models. The system addresses the challenge of numerical execution inconsistencies between traini…
-
New FP4 fusion technique accelerates LLM pretraining, outperforming bfloat16
Researchers have developed a new technique called format-aware fusion to accelerate the pretraining of large language models using four-bit floating-point (FP4) precision. This method optimizes the interaction between q…
-
NVIDIA Transformer Engine tutorial details GPU acceleration for LLMs
NVIDIA's Transformer Engine is detailed in a tutorial that explains how to accelerate transformer workloads. The engine combines fused GPU kernels, BF16 computation, and hardware-aware FP8 execution. The tutorial covers…