PulseAugur
EN
LIVE 16:58:11

llama.cpp releases updates with performance and stability fixes · 9 sources tracked

The llama.cpp project has released several updates, including version 0.4.1, which addresses various performance and stability issues across different platforms. Notable changes include optimizations for SYCL backends, fixes for heap corruption on CPU, and fallback mechanisms for CUDA devices lacking BF16 hardware acceleration. These updates aim to improve the efficiency and reliability of running language models on diverse hardware. AI

IMPACT These updates enhance the performance and stability of llama.cpp, potentially improving the efficiency of running local LLMs on diverse hardware.

RANK_REASON The cluster consists of multiple release notes for the llama.cpp project, detailing bug fixes and minor improvements rather than a new model release or significant research breakthrough.

Read on llama.cpp — Releases →

AI-generated summary · Google Gemini · from 125 sources. How we write summaries →

llama.cpp releases updates with performance and stability fixes · 9 sources tracked

How we ranked this

Signal score
0 / 100
Composite score across the factors below. Higher = stronger signal that this story matters right now.
Newsworthiness bucket
Tool
The cluster consists of multiple release notes for the llama.cpp project, detailing bug fixes and minor improvements rather than a new model release or significant research breakthrough.
Source corroboration
125 independent sources
Strong cross-source corroboration — multiple independent publishers covered this within the clustering window.
Topics
product, infra
Editorial topic classification. Feeds into how the story surfaces on /topic/<slug> hub pages and into the per-entity coverage mix.
AI-industry relevance
High
Clearly on-topic for AI-industry coverage.
Story freshness
50 days old
Aged out of breaking-news scoring windows; ranking reflects the durable signal from the full source set.
Coverage growth since scoring
+22 source(s) since last score
New sources have picked up this story since our last re-score. Score will update on the next scoring pass.

Full methodology in our editorial standards.

COVERAGE [125]

  1. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10999

    <details open=""> <p>Change max context length for auto-fitting with unified KV (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28849">#28849</a>)</p> </details> <p><strong>Website:</strong></p> <ul> <li><a href="https://llama.app" rel="nofol…

  2. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10998

    <details open=""> <p>qwen4exp: add hc ops (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28901">#28901</a>)</p> </details> <p><strong>Website:</strong></p> <ul> <li><a href="https://llama.app" rel="nofollow">https://llama.app</a></li> </ul> …

  3. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10997

    <details open=""> <p>HIP: broaden MoE ncols_opt tile heuristic on RDNA3.5 architecture (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28935">#28935</a>)</p> <p>It's found the MoE ncols_opt tile heuristic needs to be broadened<br /> to includ…

  4. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10996

    <details open=""> <p>chat : force <code>\n&lt;/think&gt;</code> on reasoning budget end for qwen3-coder (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28869">#28869</a>)</p> </details> <p><strong>Website:</strong></p> <ul> <li><a href="https…

  5. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10995

    <details open=""> <p>vulkan: make MUL_MAT_ID BN/2 tail unconditional (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28923">#28923</a>)</p> <p>Use BN/2 as the default for BNover2 and as the disabled fallback for BNover4, and remove the enable…

  6. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10994

    <details open=""> <p>metal: fix NaN in mul_mm_id when activations exceed f16 range (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/26223">#26223</a>)</p> <ul> <li>test-backend-ops: reproduce MUL_MAT_ID NaN for activations beyond f16</li> </ul…

  7. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10993

    <details open=""> <p>ci : add self-hosted webgpu to hf-jobs (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28712">#28712</a>)</p> <ul> <li> <p>add self-hosted vulkan and webgpu to hf-jobs</p> </li> <li> <p>try t4-medium</p> </li> <li> <p>con…

  8. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10992

    <details open=""> <p>llama-bench: support --version to print build info (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28971">#28971</a>)</p> </details> <p><strong>Website:</strong></p> <ul> <li><a href="https://llama.app" rel="nofollow">htt…

  9. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10991

    <details open=""> <p>hexagon: add back missing contiguous fast-path and hvx_copy_uu for each run (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28886">#28886</a>)</p> </details> <p><strong>Website:</strong></p> <ul> <li><a href="https://llam…

  10. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10990

    <details open=""> <p>hex-cpy: use dma if src and dst are contiguous (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28906">#28906</a>)</p> </details> <p><strong>Website:</strong></p> <ul> <li><a href="https://llama.app" rel="nofollow">https:/…

  11. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10989

    <details open=""> <p>HIP: Enable AllReduce for ROCm (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/27825">#27825</a>)</p> </details> <p><strong>Website:</strong></p> <ul> <li><a href="https://llama.app" rel="nofollow">https://llama.app</a></…

  12. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10988

    <details open=""> <p>opencl: choose the MoE expert matmul by batch size for speculative decoding/MTP (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/27637">#27637</a>)</p> <ul> <li> <p>opencl: gate the prebuilt q4_0 MoE GEMM on routing count<…

  13. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10985

    <details open=""> <p>rpc : hash-cache only weights (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28789">#28789</a>)</p> <ul> <li>rpc : hash-cache only weights</li> </ul> <p>ggml_backend_rpc_buffer_set_tensor and ggml_backend_rpc_set_tensor_…

  14. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10984

    <details open=""> <p>cuda: support row-contiguous SUM_ROWS (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/26308">#26308</a>)</p> <ul> <li> <p>cuda: support row-contiguous SUM_ROWS</p> </li> <li> <p>organize the code and add GGML_OP_MEAN to s…

  15. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10983

    <details open=""> <p>models : move build_arch_graph() after graph() template specialization (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28934">#28934</a>)</p> <p>Move build_arch_graph()'s function definitions after the graph<br /> and gra…

  16. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10982

    <details open=""> <p>vulkan: support sparse Flash Attention (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28105">#28105</a>)</p> <ul> <li> <p>vulkan: add sparse Flash Attention support for DSV4/GLM</p> </li> <li> <p>tune implementation</p> …

  17. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10981

    <details open=""> <p>OpenVINO: optimize stateful decode and GPU MoE inference (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28638">#28638</a>)</p> <ul> <li> <p>exclude GPU/NPU failing POOL_2D case</p> </li> <li> <p>Fix pool case</p> </li> <…

  18. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10980

    <details open=""> <p>opencl: add generic ssm_scan (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28881">#28881</a>)</p> <ul> <li> <p>opencl: add generic ssm_scan</p> </li> <li> <p>opencl: fix whitespace</p> </li> </ul> </details> <p><strong>…

  19. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10978

    <details open=""> <p>metal : add FA kernels for HSK=96, HSV=64 (MiniCPM3) (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28599">#28599</a>)</p> <ul> <li>metal : add FA kernels for HSK=96, HSV=64 (MiniCPM3)</li> </ul> <p>MiniCPM3 sets attenti…

  20. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10977

    <details open=""> <p>ci: Bump CUDA Windows x64 builds to 13.4.1 (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28930">#28930</a>)</p> </details> <p><strong>Website:</strong></p> <ul> <li><a href="https://llama.app" rel="nofollow">https://lla…

  21. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10976

    <details open=""> <p>ci : fix android release (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28936">#28936</a>)</p> </details> <p><strong>Website:</strong></p> <ul> <li><a href="https://llama.app" rel="nofollow">https://llama.app</a></li> </…

  22. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10970

    <details open=""> <p>HIP: fattn-mma: use fp32 accumulation on MFMA devices (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28576">#28576</a>)</p> <p>use fp32 accumulators in fattn-mma on CDNA</p> </details> <p><strong>Website:</strong></p> <u…

  23. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10964

    <details open=""> <p>llama.cpp : bump version to 0.4.1 (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28900">#28900</a>)</p> </details> <p><strong>Website:</strong></p> <ul> <li><a href="https://llama.app" rel="nofollow">https://llama.app</a…

  24. llama.cpp — Releases TIER_1 (CY) · ggerganov ·

    b10964-b10964-b29c606

    <p>llama.cpp : bump version to 0.4.1 (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28900">#28900</a>)</p>

  25. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10956

    <details open=""> <p>sycl: rfc: Use radix select for top_k (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28670">#28670</a>)</p> <ul> <li>sycl: GPU-resident TOP_K for large k, parallelised over the device</li> </ul> <p>The SYCL backend refus…

  26. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10955

    <details open=""> <p>ggml-cpu : disable PCH and fix CACHE_LINE_SIZE ambiguity to fix heap corruption (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28882">#28882</a>)</p> <p>Disable the ggml-cpu precompiled header and remove the<br /> std::h…

  27. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10952

    <details open=""> <p>sycl : fix oneDNN scratchpad breaking the pool free order (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28704">#28704</a>)</p> </details> <p><strong>Website:</strong></p> <ul> <li><a href="https://llama.app" rel="nofoll…

  28. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10951

    <details open=""> <p>common : move llama_n_rs_seq to before llama_decode (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28749">#28749</a>)</p> <p>This commit moves the llama_n_rs_seq function call to before the<br /> llama_decode call and re…

  29. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10950

    <details open=""> <p>ggml-cuda: fallback to F32 on device without BF16 hardware acceleration (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28846">#28846</a>)</p> <ul> <li> <p>ggml-cuda: fallback to F32 on device without BF16 hardware accele…

  30. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10948

    <details open=""> <p>tests : exclude HY_V4 from WebGPU test-llama-archs tests (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28855">#28855</a>)</p> <p>Co-authored-by: Stanisław Szymczyk <a href="mailto:[email protected]">[email protected]<…

  31. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10947

    <details open=""> <p>models : guard the expert FFN size fallback in nemotron-h against a zero divisor (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28779">#28779</a>)</p> <p>The NextN/MTP tail loop derives the expert FFN size as n_ff/n_expe…

  32. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10946

    <details open=""> <p>ggml-cpu(s390x): guard VXE-only repack helpers (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28775">#28775</a>)</p> </details> <p><strong>Website:</strong></p> <ul> <li><a href="https://llama.app" rel="nofollow">https:/…

  33. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10944

    <details open=""> <p>sycl : Fix get mem error (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28227">#28227</a>)</p> <ul> <li> <p>fix for unsupport zes API</p> </li> <li> <p>optimize the code</p> </li> <li> <p>adjust the log level</p> </li> <…

  34. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10941

    <details open=""> <p>tests : reduce FA test sizes (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28842">#28842</a>)</p> </details> <p><strong>Website:</strong></p> <ul> <li><a href="https://llama.app" rel="nofollow">https://llama.app</a></li…

  35. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10938

    <details open=""> <p>vulkan: workaround NV queuesubmit driver bug (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28830">#28830</a>)</p> <p>There is a driver bug where two queues on the same VkDevice simultaneously<br /> submitting can break …

  36. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10937

    <details open=""> <p>opencl: apply the noshuffle row-alignment rule to q4_K, q5_K and q8_0, not just q6_K (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28575">#28575</a>)</p> </details> <p><strong>Website:</strong></p> <ul> <li><a href="htt…

  37. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10936

    <details open=""> <p>chat : improve parsing of complex types in qwen3-coder (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28742">#28742</a>)</p> <ul> <li> <p>chat : improve schema support in qwen3 parser</p> </li> <li> <p>cont : clean up gr…

  38. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10935

    <details open=""> <p>common: add LOG_JSON macro to log structured data (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28586">#28586</a>)</p> <ul> <li> <p>add LOG_JSON macro</p> </li> <li> <p>fit: add demo LOG_JSON</p> </li> </ul> </details> …

  39. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10934

    <details open=""> <p>common : implement common_schema internal representation for JSON schemas (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28736">#28736</a>)</p> <ul> <li> <p>common : implement common_schema types</p> </li> <li> <p>common…

  40. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10933

    <details open=""> <p>jinja : support dot property integer literals (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28817">#28817</a>)</p> </details> <p><strong>Website:</strong></p> <ul> <li><a href="https://llama.app" rel="nofollow">https://…

  41. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10932

    <details open=""> <p>cmake: leave the timestamp out of precompiled headers on clang (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28816">#28816</a>)</p> <p>Clang stores the modification time of the precompiled header sources<br /> inside th…

  42. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10931

    <details open=""> <p>ui : add cache (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28802">#28802</a>)</p> <p>Signed-off-by: Adrien Gallouët <a href="mailto:[email protected]">[email protected]</a></p> </details> <p><strong>Website:</stro…

  43. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10930

    <details open=""> <p>server : allow model downloads at model limit fix issue <a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/issues/26809">#26809</a> (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28530">#2853…

  44. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10929

    <details open=""> <p>ggml-cuda: hip add specific config table for AMD GCN (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/27841">#27841</a>)</p> </details> <p><strong>Website:</strong></p> <ul> <li><a href="https://llama.app" rel="nofollow">h…

  45. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10927

    <details open=""> <p>vendor : update cpp-httplib to 0.56.0 (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28787">#28787</a>)</p> </details> <p><strong>Website:</strong></p> <ul> <li><a href="https://llama.app" rel="nofollow">https://llama.ap…

  46. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10926

    <details open=""> <p>syscl : Handle (fail gracefully) unsupported tq1_0 quants (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28681">#28681</a>)</p> </details> <p><strong>Website:</strong></p> <ul> <li><a href="https://llama.app" rel="nofoll…

  47. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10924

    <details open=""> <p>server: frame the router child state command as a whole line (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28747">#28747</a>)</p> <p>The child writes its state commands on stdout while the logger writes<br /> on stderr,…

  48. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10923

    <details open=""> <p>opencl: fix several bugs where the backend aborts (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/27630">#27630</a>)</p> </details> <p><strong>Website:</strong></p> <ul> <li><a href="https://llama.app" rel="nofollow">http…

  49. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10922

    <details open=""> <p>opencl: add bin kernel <code>kernel_gemm_noshuffle_q4_k_f32_32b_trans_ila_a8_bin</code> (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28677">#28677</a>)</p> <ul> <li> <p>opencl: add A8 Q4_K non-MoE binary kernel</p> </l…

  50. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10921

    <details open=""> <p>webgpu: align tensor bindings to the type block size (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28382">#28382</a>)</p> <p>Walk the binding offset back until the distance to the tensor is a<br /> whole number of block…

  51. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10919

    <details open=""> <p>ggml-webgpu: Update to a recent version of Dawn (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28683">#28683</a>)</p> <ul> <li> <p>ggml-webgpu: Update to a recent version of Dawn</p> </li> <li> <p>No module scanning</p> …

  52. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10917

    <details open=""> <p>cmake : skip PCH for llama-server PCH when using MSVC (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28763">#28763</a>)</p> <p>This commit fixes an issue that I introduced when adding PCH<br /> (precompiled headers) in C…

  53. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10909

    <details open=""> <p>metal : single-source fusion table + fusion debug rework (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28164">#28164</a>)</p> <ul> <li>metal : rework fusion patterns into a single table</li> </ul> <p>All fusable op patt…

  54. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10908

    <details open=""> <p>metal : fix idle threads in the remaining iq mul_mv kernels for ne00 &lt; 1024 (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28692">#28692</a>)</p> <ul> <li>metal : fix idle threads in the remaining iq mul_mv kernels fo…

  55. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10907

    <details open=""> <p>model : fix MTP context kv cache allocation for deepseek2, glm4moe, … (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28630">#28630</a>)</p> <ul> <li> <p>model : fix MTP context kv cache allocation for deepseek2, glm4moe,…

  56. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10906

    <details open=""> <p>server: fix speculation after an image (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28715">#28715</a>)</p> <ul> <li>server: fix speculation after an image</li> </ul> <p>Pass the actual position to the drafter after an …

  57. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10905

    <details open=""> <p>CUDA/HIP: Flash Attention tuning (gfx1201) (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28102">#28102</a>)</p> <ul> <li>HIP: enable mma FA for head size 256 on RDNA4, tune configs</li> </ul> <p>Assisted-by: Claude<br /…

  58. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10903

    <details open=""> <p>vulkan: fix data race and OOB access in argsort(large) (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28705">#28705</a>)</p> <p>argsort had a data race in the inner loop, which VVL caught. But I don't think<br /> this wa…

  59. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10901

    <details open=""> <p>vulkan: use CPU writes in ggml_backend_vk_cpy_tensor_async if the context is idle (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28618">#28618</a>)</p> </details> <p><strong>Website:</strong></p> <ul> <li><a href="https:…

  60. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10900

    <details open=""> <p>vulkan: use add_alloc_dep to enable topk_moe fusion for prefill (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28422">#28422</a>)</p> </details> <p><strong>Website:</strong></p> <ul> <li><a href="https://llama.app" rel="…

  61. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10899

    <details open=""> <p>vulkan: small M matrix optimizations for qwen (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28457">#28457</a>)</p> <ul> <li> <p>vulkan: optimize m=1 mul_mat by swapping A/B</p> </li> <li> <p>vulkan: Improve small M perf…

  62. llama.cpp — Releases TIER_1 (SO) · shaofeiqi ·

    b10902

    <p>opencl: add A8 Q4_0 mm binary kernel support (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28268">#28268</a>)</p>

  63. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10897

    <details open=""> <p>ci : Update WoA CUDA 13.4 release to use 13.4.1 GA redistributables (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28687">#28687</a>)</p> <ul> <li>Move Windows ARM64 CUDA 13.4 builds from the Developer Preview archives t…

  64. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10896

    <details open=""> <p>spec: fix failed to decode mtmd chunk with DFlash (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28587">#28587</a>)</p> <ul> <li>speculative: fix failed to decode mtmd chunk with DFlash</li> </ul> <p>When using DFlash w/…

  65. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10894

    <details open=""> <p>models: clean up some dead switch branches in old models (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28669">#28669</a>)</p> <p>Some of these if statements were copypastaed in a former refactor and<br /> never cleaned …

  66. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10893

    <details open=""> <p>tests : increase tolerance for Add fusion tests (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28691">#28691</a>)</p> </details> <p><strong>Website:</strong></p> <ul> <li><a href="https://llama.app" rel="nofollow">https:…

  67. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10892

    <details open=""> <p>tests : drop SYCL special-casing in test-backend-ops.cpp (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28688">#28688</a>)</p> </details> <p><strong>Website:</strong></p> <ul> <li><a href="https://llama.app" rel="nofollo…

  68. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10891

    <details open=""> <p>vulkan: fall back to shared-memory reduction for dmmv on PowerVR (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28341">#28341</a>)</p> <p>The Imagination proprietary Vulkan compiler returns VK_ERROR_UNKNOWN from<br /> vk…

  69. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10889

    <details open=""> <p>memory : avoid allocating V cache for indexer (it's not used) (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28330">#28330</a>)</p> <p>Co-authored-by: Stanisław Szymczyk <a href="mailto:[email protected]">sszymczy@gmail…

  70. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10888

    <details open=""> <p>vulkan : add command-buffer debug labels for GPU profilers (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28101">#28101</a>)</p> <ul> <li>vulkan : add command-buffer debug labels for GPU profilers</li> </ul> <p>Co-author…

  71. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10887

    <details open=""> <p>ggml-cpu(s390x): add repack support for q4_0 (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28667">#28667</a>)</p> <p>ggml-cpu: clean comments</p> <p>Signed-off-by: Aaron Teo <a href="mailto:[email protected]">aaron.teo…

  72. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10886

    <details open=""> <p>ggml-cpu(s390x): add Q1_0 vector intrinsic support (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28606">#28606</a>)</p> <ul> <li>ggml-cpu: add <code>ggml_vec_dot_q1_0_q8_0</code> support</li> </ul> <p>Signed-off-by: Aar…

  73. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10885

    <details open=""> <p>model: fix all granite family parameter counts (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28643">#28643</a>)</p> <ul> <li>model: fix all granite family parameter counts</li> </ul> <p>Signed-off-by: Aaron Teo <a href=…

  74. llama.cpp — Releases TIER_1 (SO) · netrunnereve ·

    b10884

    <p>ci: fix sanitizer tests (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28583">#28583</a>)</p>

  75. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10883

    <details open=""> <p>vulkan: use spec constant for matrix matrix multiplication A-type (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/25773">#25773</a>)</p> <ul> <li>vulkan: use spec constant for mul mat type_a</li> </ul> <p>vulkan: use map …

  76. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10881

    <details open=""> <p>vulkan: Convert FILL to distribute workgroups in 2D to avoid exceeding maxComputeWorkGroupCount (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28592">#28592</a>)</p> <ul> <li>divide workload to 2D</li> </ul> <p>This is t…

  77. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10878

    <details open=""> <p>llama : use int32_t for llama_sampler_chain_n return type (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28631">#28631</a>)</p> <p>Contributes to <a class="issue-link js-issue-link" href="https://github.com/ggml-org/llam…

  78. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10877

    <details open=""> <p>CUDA: size routed MoE MMQ N-tiles from typical expert width on RDNA3 (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28552">#28552</a>)</p> <p>Recreated from <a class="issue-link js-issue-link" href="https://github.com/gg…

  79. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10876

    <details open=""> <p>CUDA: replace GGML_FA_ALL_QUANTS with GGML_FA_QUANTS, more control over what is compiled (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28079">#28079</a>)</p> <ul> <li>CUDA: add configurable FA quant combinations</li> </…

  80. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10875

    <details open=""> <p>args: officially deprecate --mmap|mlock|dio (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28334">#28334</a>)</p> <p>Signed-off-by: Aaron Teo <a href="mailto:[email protected]">[email protected]</a></p> </details> <p><…

  81. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10874

    <details open=""> <p>model: fix granite3 moe unknown parameter count (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28632">#28632</a>)</p> <p>Signed-off-by: Aaron Teo <a href="mailto:[email protected]">[email protected]</a></p> </details> …

  82. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10873

    <details open=""> <p>mtmd: propagate video ID to bitmap (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28601">#28601</a>)</p> </details> <p><strong>Website:</strong></p> <ul> <li><a href="https://llama.app" rel="nofollow">https://llama.app</…

  83. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10872

    <details open=""> <p>jinja: treat a null left operand of in as a plain lookup (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28620">#28620</a>)</p> <p>Templates that default an optional variable to none and then test its<br /> membership in …

  84. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10871

    <details open=""> <p>vulkan: add dedicated iq4_xs mat-vec shader (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28426">#28426</a>)</p> <ul> <li>vulkan: add dedicated iq4_xs mat-vec shader</li> </ul> <p>Dedicated mul_mat_vec_iq4_xs for the dm…

  85. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10870

    <details open=""> <p>vulkan: add f16 B-type matmul pipelines and warp tile size tuning for Intel coopmat1 (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/27471">#27471</a>)</p> <ul> <li> <p>vulkan: add f16 B-type matmul pipelines and warp til…

  86. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10869

    <details open=""> <p>tests : use less threads for data initialization (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28325">#28325</a>)</p> <ul> <li> <p>tests : use 1 thread for data initialization</p> </li> <li> <p>cont : scale threads with…

  87. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10868

    <details open=""> <p>Add IQ type handling for MoE (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28476">#28476</a>)</p> <p>Co-authored-by: cwriter <a href="mailto:cwriter@localhost">cwriter@localhost</a></p> </details> <p><strong>Website:</s…

  88. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10867

    <details open=""> <p>llama: disable lazy tensor loading by default on iGPUs (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28326">#28326</a>)</p> <ul> <li> <p>llama: add lazy mode auto, fix iGPU regression</p> </li> <li> <p>revert changes ex…

  89. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10865

    <details open=""> <p>Revert "ggml-cuda : restore prop.integrated on HIP builds (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/24233">#24233</a>)" (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28604">#2…

  90. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10864

    <details open=""> <p>server : apply checkpoint min-step eviction only when the checkpoint list is full (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28302">#28302</a>)</p> <p>The spacing eviction in create_checkpoint() keeps the oldest chec…

  91. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10863

    <details open=""> <p>metal : fix idle threads in mul_mv_iq3_xxs for ne00 &lt; 1024 (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28086">#28086</a>)</p> <ul> <li> <p>metal : fix half-idle simdgroup in kernel_mul_mv_iq3_xxs_f32 for ne00 &lt; …

  92. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10859

    <details open=""> <p>llama : add missing headers (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28566">#28566</a>)</p> <ul> <li>fix compile-error: add missing header</li> </ul> <p>Bug: <a class="issue-link js-issue-link" href="https://github…

  93. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10858

    <details open=""> <p>vulkan : fuse UNARY(GELU|SIGMOID|SILU|SOFTPLUS) + MUL (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/27220">#27220</a>)</p> <ul> <li> <p>vulkan : fuse UNARY(SIGMOID|SILU|SOFTPLUS) + MUL</p> </li> <li> <p>vulkan : fuse UN…

  94. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10857

    <details open=""> <p>Fix Vulkan-Hpp handle usage on 32-bit targets. (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/22892">#22892</a>)</p> <p>On 32-bit platforms, Vulkan non-dispatchable handles such as VkBuffer are<br /> represented as uint6…

  95. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10856

    <details open=""> <p>chat : split specialized parsers into common/parsers (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/27764">#27764</a>)</p> <ul> <li>chat : split specialized parsers into common/parsers</li> </ul> <p>Move the 14 dedicated…

  96. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10855

    <details open=""> <p>opencl: properly handle non-contiguous inputs to conv2d (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28503">#28503</a>)</p> <ul> <li> <p>opencl: fix conv2d non-contiguous strides</p> </li> <li> <p>opencl: format</p> </…

  97. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10853

    <details open=""> <p>model : support Kimi-K3 recurrent-state rollback (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28466">#28466</a>)</p> </details> <p><strong>Website:</strong></p> <ul> <li><a href="https://llama.app" rel="nofollow">https…

  98. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10852

    <details open=""> <p>hexagon: add RELU and LEAKY_RELU ops (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28585">#28585</a>)</p> <ul> <li> <p>hexagon: add RELU op</p> </li> <li> <p>hexagon: add LEAKY_RELU op too</p> </li> </ul> </details> <p>…

  99. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10850

    <details open=""> <p>tests : initialize the L2_NORM batch array (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28553">#28553</a>)</p> <ul> <li>tests: bind the L2_NORM batch count to a local</li> </ul> <p>GCC cannot prove the loop fills norms…

  100. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10844

    <details open=""> <p>vulkan: add DeepSeek-V4 hyper-connection fused ops (DSV4_HC_COMB/PRE/POST) (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/26578">#26578</a>)</p> <ul> <li>vulkan: add DeepSeek-V4 hyper-connection fused ops (DSV4_HC_COMB/P…

  101. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10842

    <details open=""> <p>ggml: add gfx90c HIP support (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/26454">#26454</a>)</p> <ul> <li> <p>ggml: add gfx90c HIP support</p> </li> <li> <p>ggml: make gfx90c HIP support compliant with specifications</…

  102. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10840

    <details open=""> <p>CUDA: branchless Q4_K/Q5_K unpack to speed up mmvq, L2 prefetch on DGX Spark (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/26705">#26705</a>)</p> <ul> <li> <p>Update Q4_K and Q5_K to use branchless computation, which st…

  103. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10839

    <details open=""> <p>vulkan: support type-aligned GET_ROWS (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28253">#28253</a>)</p> <ul> <li>vulkan: fall back to CPU for GET_ROWS with misaligned offsets</li> </ul> <p>The Vulkan GET_ROWS shader …

  104. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10837

    <details open=""> <p>caps : recheck typed content if template checks for string (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28511">#28511</a>)</p> </details> <p><strong>Website:</strong></p> <ul> <li><a href="https://llama.app" rel="nofol…

  105. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10835

    <details open=""> <p>ggml-cuda: fix divergent barrier in f16 flash attention (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/27870">#27870</a>)</p> <ul> <li> <p>ggml-cuda: fix divergent barrier in f16 flash attention</p> </li> <li> <p>ggml-cu…

  106. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10834

    <details open=""> <p>ggml: allow backend inputs to not create another split (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28387">#28387</a>)</p> </details> <p><strong>Website:</strong></p> <ul> <li><a href="https://llama.app" rel="nofollow"…

  107. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10833

    <details open=""> <p>vulkan: rms_norm fusion opportunities (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28024">#28024</a>)</p> <p>Support RMS_NORM + MUL + ADD (+ MUL) and RMS_NORM + VIEW + SET_ROWS.<br /> Extend ROPE + VIEW + SET_ROWS to s…

  108. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10831

    <details open=""> <p>vulkan: add TQ1_0 support (mm, mat-vec, mat-vec-id, dequant, get_rows) (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/27765">#27765</a>)</p> <ul> <li> <p>vulkan: add TQ1_0 support (mm, mat-vec, dequant, get_rows)</p> </l…

  109. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10830

    <details open=""> <p>convert : add <code>--fuse-qkv</code> flag to fuse Q/K/V into QKV during HF-to-GGUF conversion (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/22780">#22780</a>)</p> </details> <p><strong>Website:</strong></p> <ul> <li><a…

  110. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10829

    <details open=""> <p>models : fix GDN normalization from <code>max</code> to <code>rsqrt</code> (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28068">#28068</a>)</p> <ul> <li>models: use flash-linear-attention's l2norm for gated delta net q/…

  111. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10828

    <details open=""> <p>[Model] Support for Spark2_5ForCausalLM implementation (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/27868">#27868</a>)</p> <ul> <li>Add Spark3 Model</li> <li>rename spark3 -&gt; spark2_5</li> </ul> <p>Co-authored-by: S…

  112. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10827

    <details open=""> <p>opencl: properly choose weights pack for q4_K, q5_K mul_mat (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28402">#28402</a>)</p> </details> <p><strong>Website:</strong></p> <ul> <li><a href="https://llama.app" rel="nofo…

  113. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10826

    <details open=""> <p>cuda: fixes races in mmid and mmf (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28475">#28475</a>)</p> </details> <p><strong>Website:</strong></p> <ul> <li><a href="https://llama.app" rel="nofollow">https://llama.app</a…

  114. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10825

    <details open=""> <p>grammar : fix max repetition threshold (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28469">#28469</a>)</p> </details> <p><strong>Website:</strong></p> <ul> <li><a href="https://llama.app" rel="nofollow">https://llama.a…

  115. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10823

    <details open=""> <p>common: add --log-jsonl (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28437">#28437</a>)</p> <ul> <li> <p>common: add --log-jsonl</p> </li> <li> <p>rename unknown to none</p> </li> </ul> </details> <p><strong>Website:</…

  116. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10822

    <details open=""> <p>ui : embed assets directly with CMake (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28445">#28445</a>)</p> <p>Remove the build-time C++ helper and external gzip dependency,<br /> simplifying cross-compilation. Keep the …

  117. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10821

    <details open=""> <p>metal : add remaining fa-vec tunings for M2 Max (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28458">#28458</a>)</p> </details> <p><strong>Website:</strong></p> <ul> <li><a href="https://llama.app" rel="nofollow">https:…

  118. llama.cpp — Releases TIER_1 (SO) · JohannesGaessler ·

    b10820

    <p>Github: limit blank issues to maintainers (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28435">#28435</a>)</p>

  119. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10819

    <details open=""> <p>metal : fix memory leak in early return (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28399">#28399</a>)</p> </details> <p><strong>Website:</strong></p> <ul> <li><a href="https://llama.app" rel="nofollow">https://llama.…

  120. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10817

    <details open=""> <p>sycl: attribute device allocations by site (GGML_SYCL_MEMTRACE) (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/27631">#27631</a>)</p> <p>define two new environment variables to better understand how much<br /> memory is …

  121. llama.cpp — Releases TIER_1 (SO) · philip-jingxin ·

    b10818

    <p>sycl : fix test-backend-ops CI break &amp;&amp; restore Kronecker product FWH…</p>

  122. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10816

    <details open=""> <p>metal : add remaining fa-vec tunings for M3 (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28396">#28396</a>)</p> <ul> <li> <p>addition of m3 in fa_vec_tuned_table</p> </li> <li> <p>adding q4_0,q4_1,q5_0,q5_1 in ggml-met…

  123. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10814

    <details open=""> <p>opencl: extend the elementwise and data‐movement op coverage (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/27633">#27633</a>)</p> <ul> <li>opencl: add extended elementwise unary ops (sgn, step, elu, hardswish, hardsigmo…

  124. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10813

    <details open=""> <p>opencl: add Adreno xmem SDPA path (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/26331">#26331</a>)</p> <ul> <li>opencl: add Adreno xmem SDPA path</li> </ul> <p>Assisted-by: Codex</p> <ul> <li> <p>Removed the Adreno-spec…

  125. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10809

    <details open=""> <p>llama.cpp : bump version to 0.4.0 (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28386">#28386</a>)</p> </details> <p><strong>Website:</strong></p> <ul> <li><a href="https://llama.app" rel="nofollow">https://llama.app</a…