CUDA
PulseAugur coverage of CUDA — every cluster mentioning CUDA across labs, papers, and developer communities, ranked by signal.
- developed by Nvidia 100%
- used by NVIDIA H100 90%
- used by DGX Spark 90%
- acquired by MODULAR 90%
- used by NVIDIA GB10 Grace Blackwell Superchip 90%
- used by CPP 90%
- used by EXL3 90%
- used by resk-logits 90%
- competes with MODULAR 80%
- used by ggml-org 80%
- competes with Huawei Ascend 80%
- instance of graphics processing unit 70%
- 2026-09-10 product_launch NVIDIA has made CUDA available for ARM processors on Windows. source
21 day(s) with sentiment data
-
Open-source Flyweight engine enables running large MoE models on single GPU with system RAM
Flyweight, an open-source C++/CUDA engine, has been released on PyPI, designed to run Mixture of Experts (MoE) models that exceed a single GPU's VRAM by utilizing system RAM. The engine supports various models including…
-
Local LLM Hardware: GPUs for Small Models, Unified Memory for Large
For running large language models locally, the hardware landscape has divided into distinct categories based on memory capacity and speed. Consumer GPUs like the RTX 5090 excel with smaller models fitting within 32 GB, …
-
Nunchux AI unveils VC-Attention to speed up video diffusion transformers
Nunchux AI has developed VC-Attention, a novel training-free low-bit attention kernel designed to accelerate video diffusion transformers. This innovation addresses two key bottlenecks: value quantization errors and the…
-
llama.cpp releases bring OpenVINO updates, Vulkan, GGUF, and SYCL improvements
The llama.cpp project has released several updates, including version b11024 which features an update to OpenVINO 2026.4 and fixes for various compiler warnings. Other recent releases, such as b11022 and b11020, introdu…
-
New CUDA implementation accelerates instance segmentation decoding
Researchers have developed a new CUDA-based implementation to accelerate the decoding stage of instance segmentation models that use centroid positional encoding. This method addresses computational bottlenecks by optim…
-
NVIDIA unveils cuDNN Graph API for optimized AI computation graphs
NVIDIA has introduced the cuDNN Graph API, a new feature within its cuDNN Frontend that allows developers to define computations as graphs of operations. This API enables cuDNN to automatically select and optimize execu…
-
llama.cpp update enables i16 and i32 support for DUP on CUDA
The llama.cpp project has released an update, version b10975, which includes enhancements for CUDA. This update specifically enables support for i16 and i32 data types within the DUP (Democratic Unionist Party) operatio…
-
New research optimizes KV cache usage for LLMs, improving efficiency and accuracy
Recent research explores methods to optimize KV cache usage in large language models, particularly for long contexts and agentic systems. One paper proposes a budgeted repair strategy for stale KV caches after document …
-
llama.cpp adds Ubuntu-CUDA builds and GCC 14 support in latest release
The llama.cpp project has released version b10969, which includes new build jobs for Ubuntu-CUDA, supporting CUDA versions 12.8 and 13.3 on both x64 and arm64 architectures. This update also incorporates GCC 14 for CUDA…
-
FlashAttention efficiency and H-1B visa fee impact on tech jobs
The first item discusses FlashAttention, a technique developed by Tri Dao at Stanford University, which optimizes the attention mechanism in Transformer models. This method, implemented using PyTorch and CUDA, aims to i…
-
New tools and research tackle GPU optimization for AI workloads
Several research papers and a new open-source tool address challenges in optimizing AI workloads on GPUs. COMPASS-ABS aims to reduce fragmentation in shared GPU clusters for deep learning training, improving resource ut…
-
Einsummable package enables automatic multi-GPU parallelism for AI
A new package called Einsummable has been developed to automatically parallelize AI computations across multiple GPUs. This approach leverages CUDA and Triton to enable efficient multi-GPU execution for large language m…
-
ZLUDA enables CUDA apps on AMD GPUs for Windows
A project called ZLUDA is enabling Windows applications that target NVIDIA's CUDA to run on AMD GPUs. This compatibility layer, which utilizes ROCm/HIP, offers a performance that is approximately 3% slower than native C…
-
CUDA support for AMD hardware on Windows emerges via GitHub project
A GitHub repository has been created by user Speedstu to enable CUDA functionality on AMD hardware running Microsoft Windows. This project aims to bridge the gap between NVIDIA's proprietary CUDA platform and AMD's grap…
-
Qwen 3.8-27B model performance boosted on 16GB GPUs with new VRAM management
A developer has implemented a novel technique to enhance the performance of the Qwen 3.8-27B model on hardware with limited VRAM, specifically 16GB CUDA-enabled GPUs. This method builds upon existing KV cache streaming …
-
New .NET 10 engine enables local LLM inference without C++ or Python
A new inference engine called Glacier.Inference has been developed for .NET 10 that allows local LLMs to run without C++ or Python dependencies. This engine bypasses traditional CUDA toolkits and native C++ DLLs by inte…
-
Scavenger finds 12 Nvidia RTX 3070 GPUs from crypto mining era
A Reddit user discovered a cache of 12 Nvidia GeForce RTX 3070 graphics cards, originally used for cryptocurrency mining, stored in a basement. Despite years of disuse and minor signs of wear, the cards are believed to …
-
Rust clients demonstrate Gemma 4 interaction via HTTP and MCP
This article details the creation of two Rust command-line interface (CLI) clients designed to interact with the Gemma 4 model. One client directly queries the model's HTTP endpoint, mimicking an OpenAI-compatible inter…
-
Running multiple AI models on one GPU: challenges and considerations
This article explores the challenges of running multiple AI models on a single GPU, focusing on potential conflicts and performance degradation. It highlights key questions to consider regarding model interference, syst…
-
llama.cpp sees Flash Attention tuning for RDNA GPUs
A pull request has been submitted to the llama.cpp project, focusing on optimizing Flash Attention for CUDA and HIP architectures. The changes specifically target the gfx1201 hardware, with potential performance improve…