Vulkan
PulseAugur coverage of Vulkan — every cluster mentioning Vulkan across labs, papers, and developer communities, ranked by signal.
17 day(s) with sentiment data
-
Shotcut 26.6 video editor adds Vulkan support and OpenFX plugins
The open-source video editor Shotcut has released version 26.6, introducing several new features and improvements. This update includes initial support for OpenFX plugins, Vulkan rendering on Linux, and compatibility wi…
-
DXVK 3.0 released with shader compilation and D3D9 improvements
DXVK 3.0 has been released, offering a Vulkan-based implementation for Direct3D 9, 10, and 11 on Linux and Wine. This new version includes enhancements to shader compilation and improvements for Direct3D 9, aiming to pr…
-
Run Alibaba's Qwen LLM locally and offline with Off Grid AI Desktop
Off Grid AI Desktop is a new, free, open-source application that allows users to run Alibaba Group's Qwen large language models locally on their personal computers. This enables offline, private AI interactions, with th…
-
Run Google's Gemma LLM Locally with New Open-Source App
A new open-source application called Off Grid AI Desktop allows users to run Google's Gemma language models locally on their Mac or Windows computers. This approach prioritizes user privacy by keeping all prompts and da…
-
AMD Strix Halo NPUs Now Usable for LLM Inference with Lemonade Software
A new software development, Lemonade, has been released that enables the use of the Neural Processing Unit (NPU) on AMD Strix Halo devices for running large language models. This allows for hybrid models that leverage b…
-
Open-source Nvidia Vulkan driver NVK adds experimental DLSS support on Linux
The open-source Vulkan driver NVK, developed for Nvidia GPUs on Linux, has introduced experimental support for Nvidia's DLSS upscaling technology. This integration is achieved by loading pre-compiled CUDA binaries direc…
-
llama-bench defaults corrected for flash attention and GPU layers
A recent build, b9437, for the llama-bench tool has corrected default settings related to flash attention and GPU layer counts. Previously, the tool hard-coded flash attention off, even on compatible hardware, and used …
-
llama.cpp b9680 fixes Vulkan Docker images
The llama.cpp project released version b9680, which includes fixes for its Vulkan Docker images. The update addresses an issue in vulkan-shaders-gen.cpp, adding comments to clarify code intentions and resolving potentia…
-
Intel Arc B580 GPU offers 12GB VRAM for local AI under $300
The Intel Arc B580, priced at $249, offers 12GB of VRAM and 456 GB/s of memory bandwidth, making it a cost-effective option for running 7-13B parameter LLMs and Stable Diffusion models locally. While its memory bandwidt…
-
Gemma 4 Now Runs Offline in React Native Apps with GPU Acceleration
The react-native-executorch project has successfully integrated Gemma 4, enabling offline execution of the model within React Native applications. This integration leverages GPU acceleration through the Vulkan delegate …
-
AI00 RWKV Server Offers Open-Source Inference with Vulkan Acceleration
AI00 RWKV Server is an open-source inference API server designed to run RWKV language models. It features Vulkan acceleration and offers compatibility with the OpenAI API. This tool aims to provide an efficient platform…
-
llama.cpp Releases Enhance Performance and Add New Features
The llama.cpp project has released several updates, including b9608, which features an update to cpp-httplib and provides pre-compiled binaries for various platforms like macOS, Linux, Android, and Windows. Release b960…
-
Ollama 0.30 speeds up local Qwen model inference on NVIDIA GPUs
Ollama version 0.30 has been released, significantly boosting local inference speeds for Qwen models on NVIDIA GPUs. This update enhances support for Vulkan and NVIDIA hardware, improves GGUF compatibility, and streamli…
-
Developer runs LLM inference on Samsung Galaxy Z Fold6
A developer has created an Android application called Pocket Node that enables local inference of large language models on a Samsung Galaxy Z Fold6. The app utilizes llama.cpp with a Vulkan backend for efficient process…
-
LLM user seeks faster prompt processing for long agentic runs
A user on the r/LocalLLaMA subreddit is seeking methods to improve prompt processing speed for large language models, specifically mentioning issues with Qwen and a significant drop in tokens per second as context lengt…
-
AMD MI50 GPUs show strong performance with llama.cpp on Debian
A user on Reddit's r/LocalLLaMA shared performance benchmarks for AMD MI50 GPUs running the llama.cpp software on Debian Testing. The benchmarks, conducted using the llama-benchy tool with the unsloth/Qwen3.6-35B-A3B-GG…
-
llama.cpp gains 28% context with OpenBLAS build
A user on Reddit's r/LocalLLaMA subreddit has discovered that compiling the llama.cpp software with OpenBLAS support, in addition to Vulkan, allows for a significant increase in context window size. When using the Qwen …
-
Gemma 4 12B Heretic model generates full game in single HTML file
A user on Reddit shared their experience using a "heretic" version of the Gemma 4 12B model for a coding task. This modified model successfully generated a complete, playable "Retro Cyberpunk Brick Breaker" game within …
-
Android phone becomes Vulkan-accelerated local LLM node
A user has successfully repurposed an Android phone into a local LLM inference node, leveraging Vulkan for GPU acceleration. This setup allows the phone to run GGUF models and expose an OpenAI-compatible API within a se…
-
Intel Arc B580 GPU challenges RTX 3060 for local AI
Intel's Arc B580 GPU offers a compelling 12GB of VRAM and 456 GB/s of memory bandwidth for $249, making it a strong contender for local AI tasks on paper. However, its practical performance is hampered by Intel's less m…