PulseAugur
中
实时 15:29:35

llama.cpp 发布更新,修复性能和稳定性问题 · 跟踪 9 个来源

llama.cpp 项目发布了多个更新,包括 0.4.1 版本,该版本解决了跨不同平台的各种性能和稳定性问题。值得注意的更改包括对 SYCL 后端的优化、CPU 堆损坏的修复以及对缺乏 BF16 硬件加速的 CUDA 设备的后备机制。这些更新旨在提高在各种硬件上运行语言模型的效率和可靠性。 AI

影响 这些更新提高了 llama.cpp 的性能和稳定性,可能提高了在各种硬件上运行本地 LLM 的效率。

排序理由 该集群包含 llama.cpp 项目的多个发布说明,详细介绍了错误修复和小的改进,而不是新的模型发布或重大的研究突破。

在 llama.cpp — Releases 阅读 →

AI 生成摘要 · Google Gemini · 来自 125 个来源。 我们如何撰写摘要 →

llama.cpp 发布更新,修复性能和稳定性问题 · 跟踪 9 个来源

本文如何被排名

Signal score
0 / 100
Composite score across the factors below. Higher = stronger signal that this story matters right now.
Newsworthiness bucket
Tool
该集群包含 llama.cpp 项目的多个发布说明,详细介绍了错误修复和小的改进,而不是新的模型发布或重大的研究突破。
Source corroboration
125 independent sources
Strong cross-source corroboration — multiple independent publishers covered this within the clustering window.
Topics
product, infra
Editorial topic classification. Feeds into how the story surfaces on /topic/<slug> hub pages and into the per-entity coverage mix.
AI-industry relevance
High
Clearly on-topic for AI-industry coverage.
Story freshness
50 days old
Aged out of breaking-news scoring windows; ranking reflects the durable signal from the full source set.
Coverage growth since scoring
+22 source(s) since last score
New sources have picked up this story since our last re-score. Score will update on the next scoring pass.

完整方法见我们的编辑标准。

报道来源 [125]

  1. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10999

    <details open=""> <p>Change max context length for auto-fitting with unified KV (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28849">#28849</a>)</p> </details> <p><strong>Website:</strong></p> <ul> <li><a href="https://llama.app" rel="nofol…

  2. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10998

    <details open=""> <p>qwen4exp: add hc ops (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28901">#28901</a>)</p> </details> <p><strong>Website:</strong></p> <ul> <li><a href="https://llama.app" rel="nofollow">https://llama.app</a></li> </ul> …

  3. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10997

    <details open=""> <p>HIP: broaden MoE ncols_opt tile heuristic on RDNA3.5 architecture (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28935">#28935</a>)</p> <p>It's found the MoE ncols_opt tile heuristic needs to be broadened<br /> to includ…

  4. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10996

    <details open=""> <p>chat : force <code>\n&lt;/think&gt;</code> on reasoning budget end for qwen3-coder (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28869">#28869</a>)</p> </details> <p><strong>Website:</strong></p> <ul> <li><a href="https…

  5. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10995

    <details open=""> <p>vulkan: make MUL_MAT_ID BN/2 tail unconditional (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28923">#28923</a>)</p> <p>Use BN/2 as the default for BNover2 and as the disabled fallback for BNover4, and remove the enable…

  6. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10994

    <details open=""> <p>metal: fix NaN in mul_mm_id when activations exceed f16 range (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/26223">#26223</a>)</p> <ul> <li>test-backend-ops: reproduce MUL_MAT_ID NaN for activations beyond f16</li> </ul…

  7. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10993

    <details open=""> <p>ci : add self-hosted webgpu to hf-jobs (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28712">#28712</a>)</p> <ul> <li> <p>add self-hosted vulkan and webgpu to hf-jobs</p> </li> <li> <p>try t4-medium</p> </li> <li> <p>con…

  8. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10992

    <details open=""> <p>llama-bench: support --version to print build info (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28971">#28971</a>)</p> </details> <p><strong>Website:</strong></p> <ul> <li><a href="https://llama.app" rel="nofollow">htt…

  9. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10991

    <details open=""> <p>hexagon: add back missing contiguous fast-path and hvx_copy_uu for each run (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28886">#28886</a>)</p> </details> <p><strong>Website:</strong></p> <ul> <li><a href="https://llam…

  10. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10990

    <details open=""> <p>hex-cpy: use dma if src and dst are contiguous (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28906">#28906</a>)</p> </details> <p><strong>Website:</strong></p> <ul> <li><a href="https://llama.app" rel="nofollow">https:/…

  11. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10989

    <details open=""> <p>HIP: Enable AllReduce for ROCm (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/27825">#27825</a>)</p> </details> <p><strong>Website:</strong></p> <ul> <li><a href="https://llama.app" rel="nofollow">https://llama.app</a></…

  12. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10988

    <details open=""> <p>opencl: choose the MoE expert matmul by batch size for speculative decoding/MTP (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/27637">#27637</a>)</p> <ul> <li> <p>opencl: gate the prebuilt q4_0 MoE GEMM on routing count<…

  13. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10985

    <details open=""> <p>rpc : hash-cache only weights (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28789">#28789</a>)</p> <ul> <li>rpc : hash-cache only weights</li> </ul> <p>ggml_backend_rpc_buffer_set_tensor and ggml_backend_rpc_set_tensor_…

  14. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10984

    <details open=""> <p>cuda: support row-contiguous SUM_ROWS (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/26308">#26308</a>)</p> <ul> <li> <p>cuda: support row-contiguous SUM_ROWS</p> </li> <li> <p>organize the code and add GGML_OP_MEAN to s…

  15. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10983

    <details open=""> <p>models : move build_arch_graph() after graph() template specialization (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28934">#28934</a>)</p> <p>Move build_arch_graph()'s function definitions after the graph<br /> and gra…

  16. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10982

    <details open=""> <p>vulkan: support sparse Flash Attention (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28105">#28105</a>)</p> <ul> <li> <p>vulkan: add sparse Flash Attention support for DSV4/GLM</p> </li> <li> <p>tune implementation</p> …

  17. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10981

    <details open=""> <p>OpenVINO: optimize stateful decode and GPU MoE inference (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28638">#28638</a>)</p> <ul> <li> <p>exclude GPU/NPU failing POOL_2D case</p> </li> <li> <p>Fix pool case</p> </li> <…

  18. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10980

    <details open=""> <p>opencl: add generic ssm_scan (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28881">#28881</a>)</p> <ul> <li> <p>opencl: add generic ssm_scan</p> </li> <li> <p>opencl: fix whitespace</p> </li> </ul> </details> <p><strong>…

  19. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10978

    <details open=""> <p>metal : add FA kernels for HSK=96, HSV=64 (MiniCPM3) (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28599">#28599</a>)</p> <ul> <li>metal : add FA kernels for HSK=96, HSV=64 (MiniCPM3)</li> </ul> <p>MiniCPM3 sets attenti…

  20. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10977

    <details open=""> <p>ci: Bump CUDA Windows x64 builds to 13.4.1 (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28930">#28930</a>)</p> </details> <p><strong>Website:</strong></p> <ul> <li><a href="https://llama.app" rel="nofollow">https://lla…

  21. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10976

    <details open=""> <p>ci : fix android release (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28936">#28936</a>)</p> </details> <p><strong>Website:</strong></p> <ul> <li><a href="https://llama.app" rel="nofollow">https://llama.app</a></li> </…

  22. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10970

    <details open=""> <p>HIP: fattn-mma: use fp32 accumulation on MFMA devices (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28576">#28576</a>)</p> <p>use fp32 accumulators in fattn-mma on CDNA</p> </details> <p><strong>Website:</strong></p> <u…

  23. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10964

    <details open=""> <p>llama.cpp : bump version to 0.4.1 (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28900">#28900</a>)</p> </details> <p><strong>Website:</strong></p> <ul> <li><a href="https://llama.app" rel="nofollow">https://llama.app</a…

  24. llama.cpp — Releases TIER_1 (CY) · ggerganov ·

    b10964-b10964-b29c606

    <p>llama.cpp : bump version to 0.4.1 (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28900">#28900</a>)</p>

  25. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10956

    <details open=""> <p>sycl: rfc: Use radix select for top_k (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28670">#28670</a>)</p> <ul> <li>sycl: GPU-resident TOP_K for large k, parallelised over the device</li> </ul> <p>The SYCL backend refus…

  26. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10955

    <details open=""> <p>ggml-cpu : disable PCH and fix CACHE_LINE_SIZE ambiguity to fix heap corruption (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28882">#28882</a>)</p> <p>Disable the ggml-cpu precompiled header and remove the<br /> std::h…

  27. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10952

    <details open=""> <p>sycl : fix oneDNN scratchpad breaking the pool free order (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28704">#28704</a>)</p> </details> <p><strong>Website:</strong></p> <ul> <li><a href="https://llama.app" rel="nofoll…

  28. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10951

    <details open=""> <p>common : move llama_n_rs_seq to before llama_decode (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28749">#28749</a>)</p> <p>This commit moves the llama_n_rs_seq function call to before the<br /> llama_decode call and re…

  29. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10950

    <details open=""> <p>ggml-cuda: fallback to F32 on device without BF16 hardware acceleration (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28846">#28846</a>)</p> <ul> <li> <p>ggml-cuda: fallback to F32 on device without BF16 hardware accele…

  30. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10948

    <details open=""> <p>tests : exclude HY_V4 from WebGPU test-llama-archs tests (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28855">#28855</a>)</p> <p>Co-authored-by: Stanisław Szymczyk <a href="mailto:[email protected]">[email protected]<…

  31. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10947

    <details open=""> <p>models : guard the expert FFN size fallback in nemotron-h against a zero divisor (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28779">#28779</a>)</p> <p>The NextN/MTP tail loop derives the expert FFN size as n_ff/n_expe…

  32. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10946

    <details open=""> <p>ggml-cpu(s390x): guard VXE-only repack helpers (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28775">#28775</a>)</p> </details> <p><strong>Website:</strong></p> <ul> <li><a href="https://llama.app" rel="nofollow">https:/…

  33. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10944

    <details open=""> <p>sycl : Fix get mem error (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28227">#28227</a>)</p> <ul> <li> <p>fix for unsupport zes API</p> </li> <li> <p>optimize the code</p> </li> <li> <p>adjust the log level</p> </li> <…

  34. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10941

    <details open=""> <p>tests : reduce FA test sizes (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28842">#28842</a>)</p> </details> <p><strong>Website:</strong></p> <ul> <li><a href="https://llama.app" rel="nofollow">https://llama.app</a></li…

  35. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10938

    <details open=""> <p>vulkan: workaround NV queuesubmit driver bug (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28830">#28830</a>)</p> <p>There is a driver bug where two queues on the same VkDevice simultaneously<br /> submitting can break …

  36. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10937

    <details open=""> <p>opencl: apply the noshuffle row-alignment rule to q4_K, q5_K and q8_0, not just q6_K (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28575">#28575</a>)</p> </details> <p><strong>Website:</strong></p> <ul> <li><a href="htt…

  37. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10936

    <details open=""> <p>chat : improve parsing of complex types in qwen3-coder (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28742">#28742</a>)</p> <ul> <li> <p>chat : improve schema support in qwen3 parser</p> </li> <li> <p>cont : clean up gr…

  38. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10935

    <details open=""> <p>common: add LOG_JSON macro to log structured data (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28586">#28586</a>)</p> <ul> <li> <p>add LOG_JSON macro</p> </li> <li> <p>fit: add demo LOG_JSON</p> </li> </ul> </details> …

  39. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10934

    <details open=""> <p>common : implement common_schema internal representation for JSON schemas (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28736">#28736</a>)</p> <ul> <li> <p>common : implement common_schema types</p> </li> <li> <p>common…

  40. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10933

    <details open=""> <p>jinja : support dot property integer literals (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28817">#28817</a>)</p> </details> <p><strong>Website:</strong></p> <ul> <li><a href="https://llama.app" rel="nofollow">https://…

  41. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10932

    <details open=""> <p>cmake: leave the timestamp out of precompiled headers on clang (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28816">#28816</a>)</p> <p>Clang stores the modification time of the precompiled header sources<br /> inside th…

  42. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10931

    <details open=""> <p>ui : add cache (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28802">#28802</a>)</p> <p>Signed-off-by: Adrien Gallouët <a href="mailto:[email protected]">[email protected]</a></p> </details> <p><strong>Website:</stro…

  43. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10930

    <details open=""> <p>server : allow model downloads at model limit fix issue <a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/issues/26809">#26809</a> (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28530">#2853…

  44. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10929

    <details open=""> <p>ggml-cuda: hip add specific config table for AMD GCN (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/27841">#27841</a>)</p> </details> <p><strong>Website:</strong></p> <ul> <li><a href="https://llama.app" rel="nofollow">h…

  45. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10927

    <details open=""> <p>vendor : update cpp-httplib to 0.56.0 (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28787">#28787</a>)</p> </details> <p><strong>Website:</strong></p> <ul> <li><a href="https://llama.app" rel="nofollow">https://llama.ap…

  46. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10926

    <details open=""> <p>syscl : Handle (fail gracefully) unsupported tq1_0 quants (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28681">#28681</a>)</p> </details> <p><strong>Website:</strong></p> <ul> <li><a href="https://llama.app" rel="nofoll…

  47. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10924

    <details open=""> <p>server: frame the router child state command as a whole line (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28747">#28747</a>)</p> <p>The child writes its state commands on stdout while the logger writes<br /> on stderr,…

  48. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10923

    <details open=""> <p>opencl: fix several bugs where the backend aborts (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/27630">#27630</a>)</p> </details> <p><strong>Website:</strong></p> <ul> <li><a href="https://llama.app" rel="nofollow">http…

  49. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10922

    <details open=""> <p>opencl: add bin kernel <code>kernel_gemm_noshuffle_q4_k_f32_32b_trans_ila_a8_bin</code> (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28677">#28677</a>)</p> <ul> <li> <p>opencl: add A8 Q4_K non-MoE binary kernel</p> </l…

  50. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10921

    <details open=""> <p>webgpu: align tensor bindings to the type block size (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28382">#28382</a>)</p> <p>Walk the binding offset back until the distance to the tensor is a<br /> whole number of block…

  51. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10919

    <details open=""> <p>ggml-webgpu: Update to a recent version of Dawn (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28683">#28683</a>)</p> <ul> <li> <p>ggml-webgpu: Update to a recent version of Dawn</p> </li> <li> <p>No module scanning</p> …

  52. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10917

    <details open=""> <p>cmake : skip PCH for llama-server PCH when using MSVC (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28763">#28763</a>)</p> <p>This commit fixes an issue that I introduced when adding PCH<br /> (precompiled headers) in C…

  53. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10909

    <details open=""> <p>metal : single-source fusion table + fusion debug rework (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28164">#28164</a>)</p> <ul> <li>metal : rework fusion patterns into a single table</li> </ul> <p>All fusable op patt…

  54. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10908

    <details open=""> <p>metal : fix idle threads in the remaining iq mul_mv kernels for ne00 &lt; 1024 (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28692">#28692</a>)</p> <ul> <li>metal : fix idle threads in the remaining iq mul_mv kernels fo…

  55. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10907

    <details open=""> <p>model : fix MTP context kv cache allocation for deepseek2, glm4moe, … (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28630">#28630</a>)</p> <ul> <li> <p>model : fix MTP context kv cache allocation for deepseek2, glm4moe,…

  56. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10906

    <details open=""> <p>server: fix speculation after an image (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28715">#28715</a>)</p> <ul> <li>server: fix speculation after an image</li> </ul> <p>Pass the actual position to the drafter after an …

  57. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10905

    <details open=""> <p>CUDA/HIP: Flash Attention tuning (gfx1201) (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28102">#28102</a>)</p> <ul> <li>HIP: enable mma FA for head size 256 on RDNA4, tune configs</li> </ul> <p>Assisted-by: Claude<br /…

  58. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10903

    <details open=""> <p>vulkan: fix data race and OOB access in argsort(large) (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28705">#28705</a>)</p> <p>argsort had a data race in the inner loop, which VVL caught. But I don't think<br /> this wa…

  59. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10901

    <details open=""> <p>vulkan: use CPU writes in ggml_backend_vk_cpy_tensor_async if the context is idle (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28618">#28618</a>)</p> </details> <p><strong>Website:</strong></p> <ul> <li><a href="https:…

  60. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10900

    <details open=""> <p>vulkan: use add_alloc_dep to enable topk_moe fusion for prefill (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28422">#28422</a>)</p> </details> <p><strong>Website:</strong></p> <ul> <li><a href="https://llama.app" rel="…

  61. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10899

    <details open=""> <p>vulkan: small M matrix optimizations for qwen (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28457">#28457</a>)</p> <ul> <li> <p>vulkan: optimize m=1 mul_mat by swapping A/B</p> </li> <li> <p>vulkan: Improve small M perf…

  62. llama.cpp — Releases TIER_1 (SO) · shaofeiqi ·

    b10902

    <p>opencl: add A8 Q4_0 mm binary kernel support (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28268">#28268</a>)</p>

  63. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10897

    <details open=""> <p>ci : Update WoA CUDA 13.4 release to use 13.4.1 GA redistributables (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28687">#28687</a>)</p> <ul> <li>Move Windows ARM64 CUDA 13.4 builds from the Developer Preview archives t…

  64. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10896

    <details open=""> <p>spec: fix failed to decode mtmd chunk with DFlash (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28587">#28587</a>)</p> <ul> <li>speculative: fix failed to decode mtmd chunk with DFlash</li> </ul> <p>When using DFlash w/…

  65. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10894

    <details open=""> <p>models: clean up some dead switch branches in old models (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28669">#28669</a>)</p> <p>Some of these if statements were copypastaed in a former refactor and<br /> never cleaned …

  66. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10893

    <details open=""> <p>tests : increase tolerance for Add fusion tests (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28691">#28691</a>)</p> </details> <p><strong>Website:</strong></p> <ul> <li><a href="https://llama.app" rel="nofollow">https:…

  67. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10892

    <details open=""> <p>tests : drop SYCL special-casing in test-backend-ops.cpp (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28688">#28688</a>)</p> </details> <p><strong>Website:</strong></p> <ul> <li><a href="https://llama.app" rel="nofollo…

  68. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10891

    <details open=""> <p>vulkan: fall back to shared-memory reduction for dmmv on PowerVR (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28341">#28341</a>)</p> <p>The Imagination proprietary Vulkan compiler returns VK_ERROR_UNKNOWN from<br /> vk…

  69. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10889

    <details open=""> <p>memory : avoid allocating V cache for indexer (it's not used) (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28330">#28330</a>)</p> <p>Co-authored-by: Stanisław Szymczyk <a href="mailto:[email protected]">sszymczy@gmail…

  70. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10888

    <details open=""> <p>vulkan : add command-buffer debug labels for GPU profilers (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28101">#28101</a>)</p> <ul> <li>vulkan : add command-buffer debug labels for GPU profilers</li> </ul> <p>Co-author…

  71. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10887

    <details open=""> <p>ggml-cpu(s390x): add repack support for q4_0 (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28667">#28667</a>)</p> <p>ggml-cpu: clean comments</p> <p>Signed-off-by: Aaron Teo <a href="mailto:[email protected]">aaron.teo…

  72. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10886

    <details open=""> <p>ggml-cpu(s390x): add Q1_0 vector intrinsic support (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28606">#28606</a>)</p> <ul> <li>ggml-cpu: add <code>ggml_vec_dot_q1_0_q8_0</code> support</li> </ul> <p>Signed-off-by: Aar…

  73. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10885

    <details open=""> <p>model: fix all granite family parameter counts (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28643">#28643</a>)</p> <ul> <li>model: fix all granite family parameter counts</li> </ul> <p>Signed-off-by: Aaron Teo <a href=…

  74. llama.cpp — Releases TIER_1 (SO) · netrunnereve ·

    b10884

    <p>ci: fix sanitizer tests (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28583">#28583</a>)</p>

  75. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10883

    <details open=""> <p>vulkan: use spec constant for matrix matrix multiplication A-type (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/25773">#25773</a>)</p> <ul> <li>vulkan: use spec constant for mul mat type_a</li> </ul> <p>vulkan: use map …

  76. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10881

    <details open=""> <p>vulkan: Convert FILL to distribute workgroups in 2D to avoid exceeding maxComputeWorkGroupCount (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28592">#28592</a>)</p> <ul> <li>divide workload to 2D</li> </ul> <p>This is t…

  77. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10878

    <details open=""> <p>llama : use int32_t for llama_sampler_chain_n return type (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28631">#28631</a>)</p> <p>Contributes to <a class="issue-link js-issue-link" href="https://github.com/ggml-org/llam…

  78. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10877

    <details open=""> <p>CUDA: size routed MoE MMQ N-tiles from typical expert width on RDNA3 (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28552">#28552</a>)</p> <p>Recreated from <a class="issue-link js-issue-link" href="https://github.com/gg…

  79. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10876

    <details open=""> <p>CUDA: replace GGML_FA_ALL_QUANTS with GGML_FA_QUANTS, more control over what is compiled (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28079">#28079</a>)</p> <ul> <li>CUDA: add configurable FA quant combinations</li> </…

  80. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10875

    <details open=""> <p>args: officially deprecate --mmap|mlock|dio (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28334">#28334</a>)</p> <p>Signed-off-by: Aaron Teo <a href="mailto:[email protected]">[email protected]</a></p> </details> <p><…

  81. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10874

    <details open=""> <p>model: fix granite3 moe unknown parameter count (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28632">#28632</a>)</p> <p>Signed-off-by: Aaron Teo <a href="mailto:[email protected]">[email protected]</a></p> </details> …

  82. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10873

    <details open=""> <p>mtmd: propagate video ID to bitmap (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28601">#28601</a>)</p> </details> <p><strong>Website:</strong></p> <ul> <li><a href="https://llama.app" rel="nofollow">https://llama.app</…

  83. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10872

    <details open=""> <p>jinja: treat a null left operand of in as a plain lookup (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28620">#28620</a>)</p> <p>Templates that default an optional variable to none and then test its<br /> membership in …

  84. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10871

    <details open=""> <p>vulkan: add dedicated iq4_xs mat-vec shader (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28426">#28426</a>)</p> <ul> <li>vulkan: add dedicated iq4_xs mat-vec shader</li> </ul> <p>Dedicated mul_mat_vec_iq4_xs for the dm…

  85. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10870

    <details open=""> <p>vulkan: add f16 B-type matmul pipelines and warp tile size tuning for Intel coopmat1 (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/27471">#27471</a>)</p> <ul> <li> <p>vulkan: add f16 B-type matmul pipelines and warp til…

  86. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10869

    <details open=""> <p>tests : use less threads for data initialization (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28325">#28325</a>)</p> <ul> <li> <p>tests : use 1 thread for data initialization</p> </li> <li> <p>cont : scale threads with…

  87. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10868

    <details open=""> <p>Add IQ type handling for MoE (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28476">#28476</a>)</p> <p>Co-authored-by: cwriter <a href="mailto:cwriter@localhost">cwriter@localhost</a></p> </details> <p><strong>Website:</s…

  88. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10867

    <details open=""> <p>llama: disable lazy tensor loading by default on iGPUs (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28326">#28326</a>)</p> <ul> <li> <p>llama: add lazy mode auto, fix iGPU regression</p> </li> <li> <p>revert changes ex…

  89. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10865

    <details open=""> <p>Revert "ggml-cuda : restore prop.integrated on HIP builds (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/24233">#24233</a>)" (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28604">#2…

  90. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10864

    <details open=""> <p>server : apply checkpoint min-step eviction only when the checkpoint list is full (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28302">#28302</a>)</p> <p>The spacing eviction in create_checkpoint() keeps the oldest chec…

  91. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10863

    <details open=""> <p>metal : fix idle threads in mul_mv_iq3_xxs for ne00 &lt; 1024 (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28086">#28086</a>)</p> <ul> <li> <p>metal : fix half-idle simdgroup in kernel_mul_mv_iq3_xxs_f32 for ne00 &lt; …

  92. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10859

    <details open=""> <p>llama : add missing headers (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28566">#28566</a>)</p> <ul> <li>fix compile-error: add missing header</li> </ul> <p>Bug: <a class="issue-link js-issue-link" href="https://github…

  93. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10858

    <details open=""> <p>vulkan : fuse UNARY(GELU|SIGMOID|SILU|SOFTPLUS) + MUL (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/27220">#27220</a>)</p> <ul> <li> <p>vulkan : fuse UNARY(SIGMOID|SILU|SOFTPLUS) + MUL</p> </li> <li> <p>vulkan : fuse UN…

  94. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10857

    <details open=""> <p>Fix Vulkan-Hpp handle usage on 32-bit targets. (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/22892">#22892</a>)</p> <p>On 32-bit platforms, Vulkan non-dispatchable handles such as VkBuffer are<br /> represented as uint6…

  95. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10856

    <details open=""> <p>chat : split specialized parsers into common/parsers (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/27764">#27764</a>)</p> <ul> <li>chat : split specialized parsers into common/parsers</li> </ul> <p>Move the 14 dedicated…

  96. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10855

    <details open=""> <p>opencl: properly handle non-contiguous inputs to conv2d (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28503">#28503</a>)</p> <ul> <li> <p>opencl: fix conv2d non-contiguous strides</p> </li> <li> <p>opencl: format</p> </…

  97. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10853

    <details open=""> <p>model : support Kimi-K3 recurrent-state rollback (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28466">#28466</a>)</p> </details> <p><strong>Website:</strong></p> <ul> <li><a href="https://llama.app" rel="nofollow">https…

  98. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10852

    <details open=""> <p>hexagon: add RELU and LEAKY_RELU ops (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28585">#28585</a>)</p> <ul> <li> <p>hexagon: add RELU op</p> </li> <li> <p>hexagon: add LEAKY_RELU op too</p> </li> </ul> </details> <p>…

  99. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10850

    <details open=""> <p>tests : initialize the L2_NORM batch array (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28553">#28553</a>)</p> <ul> <li>tests: bind the L2_NORM batch count to a local</li> </ul> <p>GCC cannot prove the loop fills norms…

  100. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10844

    <details open=""> <p>vulkan: add DeepSeek-V4 hyper-connection fused ops (DSV4_HC_COMB/PRE/POST) (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/26578">#26578</a>)</p> <ul> <li>vulkan: add DeepSeek-V4 hyper-connection fused ops (DSV4_HC_COMB/P…

  101. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10842

    <details open=""> <p>ggml: add gfx90c HIP support (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/26454">#26454</a>)</p> <ul> <li> <p>ggml: add gfx90c HIP support</p> </li> <li> <p>ggml: make gfx90c HIP support compliant with specifications</…

  102. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10840

    <details open=""> <p>CUDA: branchless Q4_K/Q5_K unpack to speed up mmvq, L2 prefetch on DGX Spark (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/26705">#26705</a>)</p> <ul> <li> <p>Update Q4_K and Q5_K to use branchless computation, which st…

  103. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10839

    <details open=""> <p>vulkan: support type-aligned GET_ROWS (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28253">#28253</a>)</p> <ul> <li>vulkan: fall back to CPU for GET_ROWS with misaligned offsets</li> </ul> <p>The Vulkan GET_ROWS shader …

  104. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10837

    <details open=""> <p>caps : recheck typed content if template checks for string (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28511">#28511</a>)</p> </details> <p><strong>Website:</strong></p> <ul> <li><a href="https://llama.app" rel="nofol…

  105. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10835

    <details open=""> <p>ggml-cuda: fix divergent barrier in f16 flash attention (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/27870">#27870</a>)</p> <ul> <li> <p>ggml-cuda: fix divergent barrier in f16 flash attention</p> </li> <li> <p>ggml-cu…

  106. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10834

    <details open=""> <p>ggml: allow backend inputs to not create another split (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28387">#28387</a>)</p> </details> <p><strong>Website:</strong></p> <ul> <li><a href="https://llama.app" rel="nofollow"…

  107. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10833

    <details open=""> <p>vulkan: rms_norm fusion opportunities (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28024">#28024</a>)</p> <p>Support RMS_NORM + MUL + ADD (+ MUL) and RMS_NORM + VIEW + SET_ROWS.<br /> Extend ROPE + VIEW + SET_ROWS to s…

  108. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10831

    <details open=""> <p>vulkan: add TQ1_0 support (mm, mat-vec, mat-vec-id, dequant, get_rows) (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/27765">#27765</a>)</p> <ul> <li> <p>vulkan: add TQ1_0 support (mm, mat-vec, dequant, get_rows)</p> </l…

  109. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10830

    <details open=""> <p>convert : add <code>--fuse-qkv</code> flag to fuse Q/K/V into QKV during HF-to-GGUF conversion (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/22780">#22780</a>)</p> </details> <p><strong>Website:</strong></p> <ul> <li><a…

  110. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10829

    <details open=""> <p>models : fix GDN normalization from <code>max</code> to <code>rsqrt</code> (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28068">#28068</a>)</p> <ul> <li>models: use flash-linear-attention's l2norm for gated delta net q/…

  111. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10828

    <details open=""> <p>[Model] Support for Spark2_5ForCausalLM implementation (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/27868">#27868</a>)</p> <ul> <li>Add Spark3 Model</li> <li>rename spark3 -&gt; spark2_5</li> </ul> <p>Co-authored-by: S…

  112. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10827

    <details open=""> <p>opencl: properly choose weights pack for q4_K, q5_K mul_mat (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28402">#28402</a>)</p> </details> <p><strong>Website:</strong></p> <ul> <li><a href="https://llama.app" rel="nofo…

  113. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10826

    <details open=""> <p>cuda: fixes races in mmid and mmf (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28475">#28475</a>)</p> </details> <p><strong>Website:</strong></p> <ul> <li><a href="https://llama.app" rel="nofollow">https://llama.app</a…

  114. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10825

    <details open=""> <p>grammar : fix max repetition threshold (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28469">#28469</a>)</p> </details> <p><strong>Website:</strong></p> <ul> <li><a href="https://llama.app" rel="nofollow">https://llama.a…

  115. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10823

    <details open=""> <p>common: add --log-jsonl (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28437">#28437</a>)</p> <ul> <li> <p>common: add --log-jsonl</p> </li> <li> <p>rename unknown to none</p> </li> </ul> </details> <p><strong>Website:</…

  116. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10822

    <details open=""> <p>ui : embed assets directly with CMake (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28445">#28445</a>)</p> <p>Remove the build-time C++ helper and external gzip dependency,<br /> simplifying cross-compilation. Keep the …

  117. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10821

    <details open=""> <p>metal : add remaining fa-vec tunings for M2 Max (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28458">#28458</a>)</p> </details> <p><strong>Website:</strong></p> <ul> <li><a href="https://llama.app" rel="nofollow">https:…

  118. llama.cpp — Releases TIER_1 (SO) · JohannesGaessler ·

    b10820

    <p>Github: limit blank issues to maintainers (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28435">#28435</a>)</p>

  119. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10819

    <details open=""> <p>metal : fix memory leak in early return (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28399">#28399</a>)</p> </details> <p><strong>Website:</strong></p> <ul> <li><a href="https://llama.app" rel="nofollow">https://llama.…

  120. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10817

    <details open=""> <p>sycl: attribute device allocations by site (GGML_SYCL_MEMTRACE) (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/27631">#27631</a>)</p> <p>define two new environment variables to better understand how much<br /> memory is …

  121. llama.cpp — Releases TIER_1 (SO) · philip-jingxin ·

    b10818

    <p>sycl : fix test-backend-ops CI break &amp;&amp; restore Kronecker product FWH…</p>

  122. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10816

    <details open=""> <p>metal : add remaining fa-vec tunings for M3 (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28396">#28396</a>)</p> <ul> <li> <p>addition of m3 in fa_vec_tuned_table</p> </li> <li> <p>adding q4_0,q4_1,q5_0,q5_1 in ggml-met…

  123. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10814

    <details open=""> <p>opencl: extend the elementwise and data‐movement op coverage (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/27633">#27633</a>)</p> <ul> <li>opencl: add extended elementwise unary ops (sgn, step, elu, hardswish, hardsigmo…

  124. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10813

    <details open=""> <p>opencl: add Adreno xmem SDPA path (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/26331">#26331</a>)</p> <ul> <li>opencl: add Adreno xmem SDPA path</li> </ul> <p>Assisted-by: Codex</p> <ul> <li> <p>Removed the Adreno-spec…

  125. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b10809

    <details open=""> <p>llama.cpp : bump version to 0.4.0 (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28386">#28386</a>)</p> </details> <p><strong>Website:</strong></p> <ul> <li><a href="https://llama.app" rel="nofollow">https://llama.app</a…