Vulkan
PulseAugur coverage of Vulkan — every cluster mentioning Vulkan across labs, papers, and developer communities, ranked by signal.
12 day(s) with sentiment data
-
Liquid AI releases compact agent model; Mistral launches safety classifier
Liquid AI has released LFM2.5-2.6B, a compact text-only model optimized for agent harnesses and tool interaction, featuring a large context window and multilingual support. While not recommended for complex coding, its …
-
Triton driver brings DirectX 11 support to QEMU emulator
A new driver named Triton has been developed to bring DirectX 11 compatibility to QEMU, a versatile emulator and virtualizer. This driver aims to enable broader graphics support across various operating systems, includi…
-
AI photo enhancers: Upscalers vs. Generative models
AI tools for enhancing photos can be broadly categorized into upscalers and generative models, though marketing often blurs this distinction. Upscalers mathematically reconstruct existing pixels to improve clarity and r…
-
QuarkStar engine enables large LLMs on 16GB machines
A new inference engine called QuarkStar has been developed, inspired by DwarfStar but optimized for lower-spec hardware. It enables large language models like Qwen3.6-35B-A3B and KAT-Coder-V2.5-Dev to run on machines wi…
-
User encounters DSv4 Flash model loop with llama.cpp Vulkan
A user on Reddit's r/LocalLLaMA subreddit is experiencing a "doom loop" with the DSv4 Flash model when using the Q8 quantization with the llama.cpp Vulkan implementation. The model gets stuck in a repetitive output loop…
-
New C#/.NET engine TensorSharp rivals llama.cpp performance
TensorSharp, a new inference engine for GGUF models, has emerged as a pure C#/.NET alternative to established C/C++ engines like llama.cpp. Developed by zhongkaifu, it offers broad model and backend support, including C…
-
Moonshot releases Kimi K3 weights; Thinking Machines launches Inkling-Small
Moonshot has released the weights for Kimi K3, a massive MoE model with 2.8 trillion parameters, alongside a technical report. This model, designed for long-horizon coding and large context tasks, is noted for its advan…
-
Valve funds RADV Vulkan driver port to Windows, running Counter-Strike 2
Valve is funding a project to port the open-source Linux RADV Radeon Vulkan driver to Windows. This effort, undertaken by contractors at Collabora, aims to create a more stable and performant graphics driver option for …
-
ML inference on edge devices simplified with Vulkan backend
A software engineer from PostSlate detailed their experience implementing vendor-agnostic machine learning inference on production edge devices. To achieve broad compatibility across various hardware like NVIDIA, AMD, a…
-
LLM inference engines see major speed boosts with new techniques and optimizations · 4 sources tracked
Several projects are enhancing the performance of local LLM inference engines. Kernel Acceleration (VK) has developed three engines (VKAE, VKUE, VKIE) that improve token generation speed by up to 601 tokens per second t…
-
New research optimizes LLM inference across diverse GPUs and hardware
Researchers are developing new methods to optimize large language model (LLM) inference and training across diverse hardware. Meganeura aims for portable GPU training and inference using Vulkan and Metal, showing compet…
-
Nvidia RTX Spark N1X prototype Surface Laptop Ultra shows early promise, faces driver issues
A prototype Microsoft Surface Laptop Ultra, reportedly featuring an unreleased Nvidia RTX Spark N1X System on Chip (SoC), has been put through preliminary testing by a tech enthusiast. The N1X SoC is designed for AI tas…
-
AI models run on 2010 hardware, showing accessibility on aging systems
An individual successfully ran AI models like Ollama and Stable Diffusion on older hardware, specifically an Intel Core i5-650 from 2010 with 8 GB of RAM. The user achieved 5.5 tokens/s with Ollama and generated a 512x7…
-
Mozilla releases Llamafile 0.10.4 with single-file LLM packaging
Mozilla has released Llamafile 0.10.4, a new version of their tool designed to simplify the use of large language models (LLMs) by packaging them into a single, cross-platform file. This update includes a new component …
-
New AI Runtime OS Orchestrates Models on Commodity Hardware
A developer has created UGR, an open-source AI Runtime Operating System designed to manage AI inference workloads on commodity hardware. UGR functions as an orchestration layer above existing inference engines like llam…
-
New R package `cayleyR` solves permutation puzzles using graph theory
Researchers have developed `cayleyR`, an R package designed to solve permutation puzzles by analyzing cycle intersections within Cayley graphs. The package employs an iterative bidirectional search algorithm, generating…
-
llama.cpp releases multiple updates with cross-platform optimizations
The llama.cpp project has released several updates, including versions b10106, b10105, b10108, b10099, b10098, b10094, b10093, b10092, b10091, and b10103. These releases introduce various improvements and fixes across d…
-
Gemma 4 LLM integrated into Godot game engine using GDScript and Vulkan
A developer has successfully integrated the Gemma 4 large language model directly into the Godot game engine. This was achieved using only GDScript and Vulkan compute shaders, bypassing the need for external tools like …
-
Run Neural Networks on GPU via Vulkan: Libraries, Compilers, or Custom Engines
This article outlines three methods for running trained neural networks on a GPU using the Vulkan API. It suggests integrating existing libraries like TensorFlow Lite or ONNX Runtime, compiling models via ML compilers s…
-
Open-source AI pipeline generates game assets locally
A developer has created a comprehensive pipeline for generating game assets using open-source AI models, ported to GGML for local execution. The pipeline includes tools for text-to-speech with voice cloning (OpenMOSS), …