PulseAugur
EN
LIVE 12:49:10

llama.cpp releases b9500 with broad OS and hardware support

The llama.cpp project has released version b9500, offering pre-compiled binaries for a wide range of operating systems and hardware architectures. This release includes support for macOS (Apple Silicon and Intel), Linux (CPU, Vulkan, ROCm, OpenVINO), Android, and Windows (CPU, CUDA, Vulkan, HIP). Several experimental features, such as KleidiAI and SYCL support, have been temporarily disabled in this version. AI

IMPACT Enables broader local deployment of LLMs across diverse hardware and operating systems.

RANK_REASON This is a software release for a tool that facilitates running LLMs locally, not a core AI model release or research paper.

Read on llama.cpp — Releases →

AI-generated summary · Google Gemini · from 1 sources. How we write summaries →

llama.cpp releases b9500 with broad OS and hardware support

COVERAGE [1]

  1. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b9500

    <details open=""> <p>metal : reduce rset heartbeat from 500ms -&gt; 5ms (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/24074">#24074</a>)</p> </details> <p><strong>macOS/iOS:</strong></p> <ul> <li><a href="https://github.com/ggml-org/llama.c…