Rocm
PulseAugur coverage of Rocm — every cluster mentioning Rocm across labs, papers, and developer communities, ranked by signal.
- used by Radeon 90%
- competes with organ of the Kyushu Music Kindergarten 80%
- competes with fable 70%
- competes with Groq LPUs 70%
- instance of R9700 70%
- used by Ryzen AI Max+ 70%
- used by Heterogeneous Integration Platform 70%
- used by RX 7900 70%
- used by MiniMax H3 70%
- used by Aiterhofen 70%
- used by R9700 70%
- used by gfx1151 70%
- 2026-10-08 product_launch AMD released ROCm 10.1, an update to its open-source software platform for GPU computing. source
12 day(s) with sentiment data
-
vLLM 0.33.0 mandates CUDA 13, adopts Model Runner V2, and boosts speed
vLLM has released version 0.33.0, introducing significant changes that require user attention for a smooth upgrade. The release mandates CUDA 13.0, discontinuing support for older versions and necessitating driver updat…
-
Krea2 AI model struggles with performance on AMD GPUs
Users are discussing the performance of Krea2, an AI model, when run on AMD hardware, specifically through ComfyUI. Initial reports indicate slow iteration speeds, with users experiencing 20-40 seconds per iteration, ev…
-
User details running AI models offline on low-power mini PC
A user documented their experience running AI models offline on a low-power mini PC, the NiPoGi P1, for seven days. They utilized Gemma 4 E4B for general tasks and Qwen2.5-Coder 7B for coding, accessing them from a Mac …
-
vLLM releases 0.33.0rc2 with ROCm bugfix for AMD hardware
vLLM has released version 0.33.0rc2, which includes a bugfix for ROCm compatibility on gfx950 hardware. This specific fix addresses an issue where AITER tuned GEMM operations were skipped when the product of M and N dim…
-
llama.cpp b11989 enables sparse attention on CDNA hardware
The llama.cpp project has released version b11989, which includes enhancements for sparse attention capabilities on CDNA hardware. This update also addresses synchronization issues on older ROCm versions and optimizes t…
-
Ollama on AMD GPUs: Common failures cause silent CPU fallback
This article details five common failure points when running Ollama on an AMD GPU, which can lead to significantly slower CPU-based processing without explicit error messages. The author experienced these issues over th…
-
Muse Glimmer 30B benchmarked on AMD Strix Halo platform
The author conducted a week-long performance benchmark of the Muse Glimmer 30B model running on AMD's Strix Halo platform, specifically the Ryzen AI Max+ 395 chip. The tests, performed on Linux with ROCm, explored vario…
-
AI tools and applications showcased across Mastodon posts
Several Mastodon posts highlight diverse AI applications and development tools. One discusses treating LLM tagging as an incident-detection problem for observability. Another details how to create launch videos from HTM…
-
llama.cpp releases b11925 with expanded OS and hardware support
The llama.cpp project has released version b11925, which includes updates for various operating systems and hardware architectures. Notably, it features improvements for ROCm release builds using ccache depend mode and …
-
Lemonade Server tested on BOSGAME VTA-439 hardware
The Lemonade Server, a local AI server application, has been tested on the BOSGAME VTA-439 hardware. The tests evaluated the performance of the server across various processing units including the central processing uni…
-
User seeks to speed up MOSS-Image-SFT model generation on AMD GPU
A user on Reddit is seeking advice on how to accelerate the image generation speed of the MOSS-Image-SFT (INT8) model on their AMD RX 6600 graphics card. They are experiencing very slow generation times, with a 1MP imag…
-
Local LLM Deployment: Memory, Speed, and Runtime Considerations
When running large language models locally, users often face issues with hardware capacity and performance metrics. It's crucial to differentiate between memory fit, which can be calculated, and speed, which requires sp…
-
llama.cpp fixes RocM test failures in latest release
The llama.cpp project has released version b11682, which includes a fix for failing RocM tests. This update addresses specific issues within the RocM testing framework for the project.
-
Meta optimizes AI training for AMD GPUs with co-design approach
Meta has developed an end-to-end co-design approach to optimize AI training performance across diverse hardware, specifically focusing on AMD GPUs alongside their existing NVIDIA fleet and proprietary accelerators. This…
-
AMD's vLLM support for MegaKernel decode precedes Nvidia's CUDA
AMD has achieved a significant milestone by integrating support for the MegaKernel decode technique into the upstream vLLM framework, notably ahead of Nvidia. This advancement allows for a tenfold reduction in kernel la…
-
llama.cpp sees hardware-specific optimizations and performance gains
The llama.cpp project has seen recent optimizations targeting specific hardware and models, leading to performance improvements. One user detailed efforts to optimize for Tesla P100 GPUs with a Qwen3.6 35B model, achiev…
-
llama.cpp releases GPU fix; new research on random projections published
The llama.cpp project has released version b11847, which includes fixes for bf16 WMMA operand vector types on RDNA 3 and RDNA 4 GPUs. This update addresses compilation errors related to short and __bf16 types, ensuring …
-
AMD's AITER kernels slow Gemma 4 performance in vLLM
A technical guide details an experiment testing AMD's AITER kernels within the vLLM framework for serving the Gemma 4 12B model on an AMD MI300X GPU. The results indicated that enabling AITER, which provides tuned GPU k…
-
AMD releases ROCm 10.1 to boost AI performance
AMD has released ROCm 10.1, a new version of its open-source software platform for GPU computing. This update aims to significantly improve performance by addressing data movement bottlenecks, which are crucial for larg…
-
Users seek efficient t2v/i2v tools amid performance issues
Users on Reddit are seeking efficient tools for text-to-video (t2v) and image-to-video (i2v) generation, specifically on Windows 11. One user is experiencing significant performance issues with ComfyUI, reporting extrem…