Tensor Cores
PulseAugur coverage of Tensor Cores — every cluster mentioning Tensor Cores across labs, papers, and developer communities, ranked by signal.
-
GPU Matmul Optimization Techniques Detailed
This article delves into advanced techniques for optimizing matrix multiplication (matmul) on modern GPUs. It covers specialized hardware features like Tensor Cores and memory transfer accelerators (TMA), alongside stra…
-
Together AI releases FlashAttention-3 and -4 for faster LLM processing
Together AI has released FlashAttention-3 and FlashAttention-4, significant upgrades to their GPU-accelerated attention mechanism for large language models. FlashAttention-3, designed for Hopper GPUs, achieves up to 75%…
-
Sakana AI, NVIDIA unveil TwELL for faster LLM training and inference
Researchers from Sakana AI and NVIDIA have developed TwELL, a novel method that significantly speeds up large language model (LLM) operations. By targeting the feedforward layers, which are computationally intensive, Tw…