PulseAugur
EN
LIVE 19:37:58

llama.cpp releases add new tensor support and bug fixes

By PulseAugur Editorial · [8 sources] ·

The llama.cpp project has released several updates, including version b9297 which adds NVFP4 MTP scale tensors and links Qwen3.5 MTP tensors. Previous releases, such as b9296 and b9295, focused on bug fixes and improvements for Vulkan and other functionalities. These releases provide pre-compiled binaries for a wide range of operating systems and hardware architectures, including macOS, Linux, Android, and Windows, with support for various compute backends like CUDA, ROCm, Vulkan, and SYCL. AI

IMPACT Ongoing development of llama.cpp provides users with more efficient and compatible tools for running LLMs on diverse hardware.

RANK_REASON The cluster contains multiple releases of an open-source project that provides tools for running large language models, indicating ongoing development and updates.

Read on llama.cpp — Releases →

AI-generated summary · Google Gemini · from 8 sources. How we write summaries →

llama.cpp releases add new tensor support and bug fixes

COVERAGE [8]

  1. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b9297

    <details open=""> <p>model : add NVFP4 MTP scale tensors (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/23563">#23563</a>)</p> <ul> <li> <p>Add NVFP4 MTP scale tensors</p> </li> <li> <p>Link Qwen3.5 MTP tensors</p> </li> <li> <p>Aligned null…

  2. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b9296

    <details open=""> <p>ggml : Check the right iface method before using the fallback 2d get (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/23514">#23514</a>)</p> </details> <p><strong>macOS/iOS:</strong></p> <ul> <li><a href="https://github.co…

  3. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b9295

    <details open=""> <p>vulkan: fix windows find_package of SPIRV-Headers (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/23215">#23215</a>)</p> <ul> <li> <p>vulkan: fix windows find_package of SPIRV-Headers</p> </li> <li> <p>not windows-only</p…

  4. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b9294

    <details open=""> <p>opencl: generalize Adreno MoE kernels on M (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/23449">#23449</a>)</p> </details> <p><strong>macOS/iOS:</strong></p> <ul> <li><a href="https://github.com/ggml-org/llama.cpp/relea…

  5. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b9291

    <details open=""> <p>SYCL: improve MoE prefill throughput (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/23142">#23142</a>)</p> <ul> <li>change <code>k_copy_src1_to_contiguous</code> so that uses a precomputed contiguous mapping where all ro…

  6. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b9292

    <details open=""> <p>perplexity : fix integer overflow (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/23496">#23496</a>)</p> <p>Co-authored-by: Stanisław Szymczyk <a href="mailto:[email protected]">[email protected]</a></p> </details> <p><…

  7. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b9290

    <details open=""> <p>sycl : Level Zero detection in ggml_sycl_init (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/23097">#23097</a>)</p> <ul> <li> <p>[SYCL] Centralize Level Zero detection in ggml_sycl_init</p> </li> <li> <p>use the same wor…

  8. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b9289

    <details open=""> <p>SYCL : gated_delta_net K&gt;1 (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/23174">#23174</a>)</p> <ul> <li> <p>sycl_gated_delta_net K&gt;1</p> </li> <li> <p>editor_config</p> </li> </ul> </details> <p><strong>macOS/iOS…

RELATED ENTITIES

RELATED TOPICS