PulseAugur
EN
LIVE 14:31:01

llama.cpp project releases updates with performance and SYCL improvements

By PulseAugur Editorial · [4 sources] ·

The llama.cpp project has released several updates, including version b10306 which introduces performance improvements for SWIGLU activation functions on Apple Silicon and adds a consolidated fused-GLU kernel for SYCL. Previous releases, such as b10305 and b10303, focused on SYCL support for various operations and bug fixes. Version b10301 included a fix for CUDA warnings. AI

IMPACT Performance optimizations and expanded platform support for the llama.cpp project.

RANK_REASON This is a series of software release notes for a specific project, not a major industry-wide event.

Read on llama.cpp — Releases →

AI-generated summary · Google Gemini · from 4 sources. How we write summaries →

llama.cpp project releases updates with performance and SYCL improvements

COVERAGE [4]

  1. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10306

    <details open=""> <p>sycl: *glu flat path (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/26354">#26354</a>)</p> <ul> <li>tests: add SWIGLU perf cases</li> </ul> <p>perf mode had no GLU coverage. Adds SWIGLU at 17408 columns, 512 and<br /> 20…

  2. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10305

    <details open=""> <p>sycl : Support DSv4 OPs: LIGHTNING_INDEXER,DSV4_HC_COMB,DSV4_HC_POST,DSV4_HC_PRE (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/26568">#26568</a>)</p> <ul> <li> <p>support DSv4 OPs: LIGHTNING_INDEXER,DSV4_HC_COMB,DSV4_HC…

  3. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10303

    <details open=""> <p>sycl : fix error Error OP FLASH_ATTN_EXT on arc770 (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/26441">#26441</a>)</p> </details> <p><strong>Website:</strong></p> <ul> <li><a href="https://llama.app" rel="nofollow">htt…

  4. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10301

    <details open=""> <p>cuda: fix warnings for unused variable/function (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/26688">#26688</a>)</p> </details> <p><strong>Website:</strong></p> <ul> <li><a href="https://llama.app" rel="nofollow">https:…

RELATED ENTITIES

RELATED TOPICS