PulseAugur
EN
LIVE 20:27:43

llama.cpp project releases multiple updates with broad platform support

By PulseAugur Editorial · [6 sources] ·

The llama.cpp project has released several updates, including versions b9315, b9313, b9311, b9310, b9305, and b9301. These releases introduce various improvements and bug fixes, such as parallelizing quantization look-up table initialization and fixing checkpoint creation in the server component. The updates also provide pre-compiled binaries for a wide range of operating systems and hardware architectures, including macOS, iOS, Linux, Android, and Windows, with support for different compute backends like Vulkan, ROCm, OpenVINO, SYCL, and CUDA. AI

IMPACT Provides updated tooling for running LLMs on diverse hardware, improving accessibility and performance for developers and users.

RANK_REASON The cluster consists of multiple releases of a software project (llama.cpp) that provides tools for running large language models, rather than a new frontier model release or significant research paper.

Read on llama.cpp — Releases →

AI-generated summary · Google Gemini · from 6 sources. How we write summaries →

llama.cpp project releases multiple updates with broad platform support

COVERAGE [6]

  1. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b9315

    <details open=""> <p>llama : document that only one on-device state can be saved per sequence (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/23520">#23520</a>)</p> </details> <p><strong>macOS/iOS:</strong></p> <ul> <li><a href="https://githu…

  2. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b9313

    <details open=""> <p>ggml : Parallelize quant LUT init (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/23595">#23595</a>)</p> <ul> <li>Use OpenMP to parallelize iq2xs_init_impl and iq3xs_init_impl.</li> <li>Move the OpenMP detection from ggml…

  3. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b9311

    <details open=""> <p>vendor : update cpp-httplib to 0.45.1 (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/23639">#23639</a>)</p> </details> <p><strong>macOS/iOS:</strong></p> <ul> <li><a href="https://github.com/ggml-org/llama.cpp/releases/d…

  4. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b9310

    <details open=""> <p>server: fix checkpoints creation (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/22929">#22929</a>)</p> <ul> <li> <p>common : add common_chat_split_by_role</p> </li> <li> <p>cont : fix spans to reach end of message</p> </…

  5. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b9305

    <details open=""> <p>cmake : fix ui build (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/23592">#23592</a>)</p> <ul> <li> <p>cmake/ui : add -fPIC to llama-ui static lib</p> </li> <li> <p>cmake : rename host compiled embed helper</p> </li> </…

  6. llama.cpp — Releases TIER_1 (SO) · njsyw1997 ·

    b9301

    <p>hexagon: apply repl optimization in flash attn softmax as <a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/22993">#22993</a> (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/issues/23">#23</a>…</p>

RELATED ENTITIES

RELATED TOPICS