llama.cpp — Releases
TIER_1
(SO)
·
github-actions[bot]
·
2026-09-21 19:54
<details open=""> <p>test-llama-archs : make tensor data stdev configurable and improve help (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/29133">#29133</a>)</p> <ul> <li>test-llama-archs : make tensor data stdev configurable</li> </ul> <p>…
llama.cpp — Releases
TIER_1
(SO)
·
github-actions[bot]
·
2026-09-21 19:21
<details open=""> <p>tests/test-backend-ops : allow regex entries in the -o filter (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/29204">#29204</a>)</p> <ul> <li>tests/test-backend-ops : allow regex entries in the -o filter</li> </ul> <p>so …
llama.cpp — Releases
TIER_1
(SO)
·
github-actions[bot]
·
2026-09-21 18:52
<details open=""> <p>args: add env vars for temperature, top-p, min-p and penalties (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/27380">#27380</a>)</p> <p>Allow configuring --temp, --top-p, --min-p, --repeat-penalty,<br /> --presence-penal…
llama.cpp — Releases
TIER_1
(SO)
·
github-actions[bot]
·
2026-09-21 18:14
<details open=""> <p>server : do not forward --api-key-file to router-spawned child instances (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28938">#28938</a>)</p> <p>In router mode, authentication belongs to the router. unset_reserved_args(…
llama.cpp — Releases
TIER_1
(SO)
·
github-actions[bot]
·
2026-09-21 17:16
<details open=""> <p>tests : remove stale comment (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/29140">#29140</a>)</p> </details> <p><strong>Website:</strong></p> <ul> <li><a href="https://llama.app" rel="nofollow">https://llama.app</a></li…
llama.cpp — Releases
TIER_1
(SO)
·
github-actions[bot]
·
2026-09-21 16:46
<details open=""> <p>ggml-metal : simplify fusion pattern op list declaration (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/29206">#29206</a>)</p> <ul> <li>ggml-metal : derive non-empty fusion ops from ops_all</li> </ul> <p>Assisted-by: pi:…
llama.cpp — Releases
TIER_1
(SO)
·
github-actions[bot]
·
2026-09-21 16:04
<details open=""> <p>json: Fixed json enum handling (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28518">#28518</a>)</p> <ul> <li>Fixed json enum handling</li> </ul> <p>Added common_json_value handling for enum values.<br /> Added tests/tes…
llama.cpp — Releases
TIER_1
(SO)
·
github-actions[bot]
·
2026-09-21 15:33
<details open=""> <p>sycl : coalesce MKL-FA softmax loads instead of one work-item per row (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28918">#28918</a>)</p> <ul> <li> <p>sycl : coalesce MKL-FA softmax loads instead of one work-item per r…
llama.cpp — Releases
TIER_1
(SO)
·
github-actions[bot]
·
2026-09-21 14:15
<details open=""> <p>ci : Upgrade CUDA to 13.4 for Ubuntu CUDA Release Builds (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/29202">#29202</a>)</p> </details> <p><strong>Website:</strong></p> <ul> <li><a href="https://llama.app" rel="nofollo…
llama.cpp — Releases
TIER_1
(SO)
·
github-actions[bot]
·
2026-09-21 10:53
<details open=""> <p>hexagon: overhaul of buffer and DMA handling to support 64bit mappings + improvements (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/29197">#29197</a>)</p> <ul> <li>hex-dma64: enable support extended buffer mappings and …
llama.cpp — Releases
TIER_1
(SO)
·
github-actions[bot]
·
2026-09-21 10:17
<details open=""> <p>cuda : tune MMVQ to MMQ crossover for SM70 (Volta) (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28912">#28912</a>)</p> <ul> <li>tune MMVQ to MMQ crossover for SM70 (Volta)</li> </ul> <p>Signed-off-by: Yangyu Chen <a hr…
llama.cpp — Releases
TIER_1
(SO)
·
github-actions[bot]
·
2026-09-21 09:44
<details open=""> <p>metal : fix deprecation warnings from macOS 27 SDK (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/29136">#29136</a>)</p> </details> <p><strong>Website:</strong></p> <ul> <li><a href="https://llama.app" rel="nofollow">htt…
llama.cpp — Releases
TIER_1
(SO)
·
github-actions[bot]
·
2026-09-21 08:19
<details open=""> <p>webgpu : add fused gdn + cpy (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28976">#28976</a>)</p> </details> <p><strong>Website:</strong></p> <ul> <li><a href="https://llama.app" rel="nofollow">https://llama.app</a></li…
llama.cpp — Releases
TIER_1
(SO)
·
github-actions[bot]
·
2026-09-20 21:56
<details open=""> <p>CUDA: tune FA for Gemma 4 on Ampere or newer (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/29152">#29152</a>)</p> </details> <p><strong>Website:</strong></p> <ul> <li><a href="https://llama.app" rel="nofollow">https://l…
llama.cpp — Releases
TIER_1
(SO)
·
github-actions[bot]
·
2026-09-20 15:23
<details open=""> <p>metal : support arbitrary hc in dsv4_hc_pre (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/29169">#29169</a>)</p> <p>the dsv4_hc_pre kernels hardcoded hc = 4 via a constexpr used with<br /> simd_shuffle, so the op was re…
llama.cpp — Releases
TIER_1
(SO)
·
github-actions[bot]
·
2026-09-20 12:31
<details open=""> <p>common/peg : handle invalid utf-8 sequences in the AST (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/29161">#29161</a>)</p> <ul> <li> <p>common/peg : handle invalid utf-8 sequences in the AST</p> </li> <li> <p>cont : re…
llama.cpp — Releases
TIER_1
(SO)
·
github-actions[bot]
·
2026-09-20 09:50
<details open=""> <p>CUDA: enable sparse fa for qwen4 (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28770">#28770</a>)</p> </details> <p><strong>Website:</strong></p> <ul> <li><a href="https://llama.app" rel="nofollow">https://llama.app</a>…
llama.cpp — Releases
TIER_1
(SO)
·
github-actions[bot]
·
2026-09-20 06:09
<details open=""> <p>fix(mamba) : make time-step projection input contiguous (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28832">#28832</a>)</p> <ul> <li>mamba : make time-step projection input contiguous</li> </ul> <p>Assisted-by: ChatGPT…
llama.cpp — Releases
TIER_1
(SO)
·
github-actions[bot]
·
2026-09-20 05:44
<details open=""> <p>metal: add F16 input to the FWHT (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/29094">#29094</a>)</p> <ul> <li>metal: add F16 input to the FWHT</li> </ul> <p>The Metal FWHT kernel accepts F32 input only. This change mak…
llama.cpp — Releases
TIER_1
(SO)
·
github-actions[bot]
·
2026-09-20 00:01
<details open=""> <p>chat : add dedicated Ling 3.0 (Bailing V3) parser (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28682">#28682</a>)</p> <ul> <li>chat: add dedicated Ling 3.0 (Bailing V3) parser</li> </ul> <p>Ling 3.0 Flash templates pre…
llama.cpp — Releases
TIER_1
(SO)
·
aldehir
·
2026-09-19 23:59
<p>chat : fix gemma4 required tool grammar (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/29115">#29115</a>)</p>
llama.cpp — Releases
TIER_1
(SO)
·
github-actions[bot]
·
2026-09-19 17:55
<details open=""> <p>hexagon: enable I32 GET_ROWS (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/29116">#29116</a>)</p> </details> <p><strong>Website:</strong></p> <ul> <li><a href="https://llama.app" rel="nofollow">https://llama.app</a></li…
llama.cpp — Releases
TIER_1
(SO)
·
github-actions[bot]
·
2026-09-19 17:25
<details open=""> <p>hexagon: add support for GEGLU_QUICK (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/29114">#29114</a>)</p> </details> <p><strong>Website:</strong></p> <ul> <li><a href="https://llama.app" rel="nofollow">https://llama.app…
llama.cpp — Releases
TIER_1
(SO)
·
github-actions[bot]
·
2026-09-19 16:50
<details open=""> <p>hexagon: enable support for TOP_K op (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/29113">#29113</a>)</p> <ul> <li> <p>hexagon: enable support for TOP_K op</p> </li> <li> <p>hex-topk: thread single-row TOP_K, raise VTCM…
llama.cpp — Releases
TIER_1
(SO)
·
github-actions[bot]
·
2026-09-18 15:05
<details open=""> <p>ggml : check for allocation failures to prevent crashes (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28149">#28149</a>)</p> <ul> <li> <p>ggml : check for allocation failures to prevent crashes</p> </li> <li> <p>wording…
llama.cpp — Releases
TIER_1
(SO)
·
github-actions[bot]
·
2026-09-18 14:13
<details open=""> <p>Model-Saver: Write the SWA pattern, 15 more architectures roundtrip (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/29042">#29042</a>)</p> <ul> <li>llama: read the SWA pattern as a period or a per-layer array</li> </ul> <…
llama.cpp — Releases
TIER_1
(SO)
·
github-actions[bot]
·
2026-09-18 12:16
<details open=""> <p>ggml-webgpu: fix supports_op condition for GET_ROWS (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28978">#28978</a>)</p> <ul> <li> <p>fix get_rows vec4 handling</p> </li> <li> <p>Add src strides checking to vec4_aligned…
llama.cpp — Releases
TIER_1
(SO)
·
github-actions[bot]
·
2026-09-18 11:37
<details open=""> <p>ggml : handle graph buffer reservation failure (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/26070">#26070</a>)</p> </details> <p><strong>Website:</strong></p> <ul> <li><a href="https://llama.app" rel="nofollow">https:/…
llama.cpp — Releases
TIER_1
(SO)
·
github-actions[bot]
·
2026-09-18 11:07
<details open=""> <p>vulkan: add IQ3_S MMQ matmul kernels (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28822">#28822</a>)</p> <ul> <li> <p>vulkan: add IQ3_S MMQ matmul kernels</p> </li> <li> <p>Make block_a_to_shmem do 2-byte loads (110 by…
llama.cpp — Releases
TIER_1
(SO)
·
github-actions[bot]
·
2026-09-18 10:40
<details open=""> <p>vocab : add ufakzeka pre-tokenizer (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/29033">#29033</a>)</p> <ul> <li> <p>vocab : add ufakzeka pre-tokenizer</p> </li> <li> <p>vocab : move ufakzeka to the models list and rege…
llama.cpp — Releases
TIER_1
(SO)
·
github-actions[bot]
·
2026-09-18 09:58
<details open=""> <p>cmake : fix build when GGML_CPU=OFF and GGML_CUDA=ON (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/29026">#29026</a>)</p> <ul> <li> <p>fix: build fails when GGML_CPU=OFF and GGML_CUDA=ON</p> </li> <li> <p>fix: eol in ex…
llama.cpp — Releases
TIER_1
(SO)
·
github-actions[bot]
·
2026-09-18 08:16
<details open=""> <p>ci : bump android-actions/setup-android to 4.0.4 (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/29065">#29065</a>)</p> </details> <p><strong>Website:</strong></p> <ul> <li><a href="https://llama.app" rel="nofollow">https…
llama.cpp — Releases
TIER_1
(SO)
·
github-actions[bot]
·
2026-09-18 07:43
<details open=""> <p>vulkan: raise the hoisted row-id limit for mul_mat_id from 256 to 1024 experts (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28501">#28501</a>)</p> <ul> <li>vulkan: raise the hoisted row-id limit for mul_mat_id to 512 e…
llama.cpp — Releases
TIER_1
(SO)
·
github-actions[bot]
·
2026-09-17 17:30
<details open=""> <p>ci : add missing evict-old-files (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/29041">#29041</a>)</p> </details> <p><strong>Website:</strong></p> <ul> <li><a href="https://llama.app" rel="nofollow">https://llama.app</a>…
llama.cpp — Releases
TIER_1
(SO)
·
github-actions[bot]
·
2026-09-17 16:03
<details open=""> <p>rpc : skip ACCEL devices (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/29020">#29020</a>)</p> </details> <p><strong>Website:</strong></p> <ul> <li><a href="https://llama.app" rel="nofollow">https://llama.app</a></li> </…
llama.cpp — Releases
TIER_1
(SO)
·
github-actions[bot]
·
2026-09-17 13:34
<details open=""> <p>model : skip gate_up_exps if TENSOR_SKIP is set (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/29014">#29014</a>)</p> <p>required for qwen35moe if MTP tensors are fused but not loaded</p> </details> <p><strong>Website:</…
llama.cpp — Releases
TIER_1
(SO)
·
github-actions[bot]
·
2026-09-17 13:06
<details open=""> <p>model : extend Nemotron MTP support (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/29018">#29018</a>)</p> <ul> <li> <p>first fix</p> </li> <li> <p>removed unnecessary declarations</p> </li> </ul> </details> <p><strong>We…
llama.cpp — Releases
TIER_1
(SO)
·
github-actions[bot]
·
2026-09-17 12:33
<details open=""> <p>openvino : Update OpenVINO to 2026.4;fix clangd,MSVC warnings; (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/29009">#29009</a>)</p> <ul> <li> <p>Update to openvino-2026.4</p> </li> <li> <p>Update OV docs</p> </li> <li> …
llama.cpp — Releases
TIER_1
(SO)
·
github-actions[bot]
·
2026-09-17 11:39
<details open=""> <p>vulkan: split buffers and debug code into separate files, add shared headers (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28732">#28732</a>)</p> </details> <p><strong>Website:</strong></p> <ul> <li><a href="https://lla…
llama.cpp — Releases
TIER_1
(SO)
·
github-actions[bot]
·
2026-09-17 11:10
<details open=""> <p>chat : add message delimiters to the DeepSeek V3.2/V4 parser (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/29008">#29008</a>)</p> <ul> <li>chat : add message delimiters to the DeepSeek V3.2/V4 parser</li> </ul> <p>Assis…
llama.cpp — Releases
TIER_1
(SO)
·
github-actions[bot]
·
2026-09-17 10:39
<details open=""> <p>gguf : align the data section relative to the GGUF start, not the file (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28993">#28993</a>)</p> <ul> <li>gguf : align the data section relative to the GGUF start, not the file…
llama.cpp — Releases
TIER_1
(SO)
·
github-actions[bot]
·
2026-09-17 10:03
<details open=""> <p>sycl : fix the B70 mem allocate error when >19.3GB (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28953">#28953</a>)</p> </details> <p><strong>Website:</strong></p> <ul> <li><a href="https://llama.app" rel="nofollow">…
llama.cpp — Releases
TIER_1
(SO)
·
github-actions[bot]
·
2026-09-17 09:31
<details open=""> <p>vulkan: skip unneeded MoE work in mul_mm coopmat1 path (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/25483">#25483</a>)</p> </details> <p><strong>Website:</strong></p> <ul> <li><a href="https://llama.app" rel="nofollow"…
llama.cpp — Releases
TIER_1
(SO)
·
github-actions[bot]
·
2026-09-17 09:01
<details open=""> <p>sycl: ssm_conv: fuse the SiLU epilogue into the ssm_conv kernel (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28929">#28929</a>)</p> </details> <p><strong>Website:</strong></p> <ul> <li><a href="https://llama.app" rel="…
llama.cpp — Releases
TIER_1
(SO)
·
github-actions[bot]
·
2026-09-17 08:34
<details open=""> <p>opencl: fix various warnings (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28984">#28984</a>)</p> <ul> <li> <p>opencl: fix warnings</p> </li> <li> <p>opencl: fix warnings for non adreno</p> </li> </ul> </details> <p><st…
llama.cpp — Releases
TIER_1
(SO)
·
github-actions[bot]
·
2026-09-17 07:54
<details open=""> <p>vulkan: fix buffer_reference alignment in im2col shaders (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28996">#28996</a>)</p> <p>Both im2col.comp and im2col_3d.comp declare D_ptr without an explicit<br /> buffer_referen…
llama.cpp — Releases
TIER_1
(SO)
·
github-actions[bot]
·
2026-09-17 06:29
<details open=""> <p>vulkan: support qwen4exp hc ops (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28988">#28988</a>)</p> <ul> <li> <p>vulkan: support qwen4exp hc ops</p> </li> <li> <p>fix stale comment [no-ci]</p> </li> </ul> </details> <p…
llama.cpp — Releases
TIER_1
(SO)
·
github-actions[bot]
·
2026-09-17 02:50
<details open=""> <p>[SYCL] Fix function signature for <code>ggml_backend_sycl_split_buffer_type</code> (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28981">#28981</a>)</p> </details> <p><strong>Website:</strong></p> <ul> <li><a href="https…
llama.cpp — Releases
TIER_1
(SO)
·
github-actions[bot]
·
2026-09-17 00:05
<details open=""> <p>vulkan: work around NV bug with argsort_large.comp (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28975">#28975</a>)</p> </details> <p><strong>Website:</strong></p> <ul> <li><a href="https://llama.app" rel="nofollow">htt…
llama.cpp — Releases
TIER_1
(SO)
·
github-actions[bot]
·
2026-09-16 19:41
<details open=""> <p>TP: fix split state and granularity for fused QKV gemma4, qwen35 (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28965">#28965</a>)</p> <ul> <li>model: calculate split states for attn_qkv from n_head * n_embd_head_k</li> …
llama.cpp — Releases
TIER_1
(SO)
·
github-actions[bot]
·
2026-09-16 17:49
<details open=""> <p>Enable CUDA graph for MTP draft (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28549">#28549</a>)</p> <ul> <li> <p>Improve CUDA graph usage for MTP</p> </li> <li> <p>Rename field</p> </li> <li> <p>Address review feedback…
llama.cpp — Releases
TIER_1
(SO)
·
github-actions[bot]
·
2026-09-16 17:22
<details open=""> <p>hexagon: Support for K-Quants Q4_K and Q6_K (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28994">#28994</a>)</p> <p>implement q6k/q4k kernels</p> <p>Squashed from:<br /> feat: implement q6k kernel<br /> hex-q6k: improve…
llama.cpp — Releases
TIER_1
(SO)
·
github-actions[bot]
·
2026-09-16 16:53
<details open=""> <p>hexagon: accept the zeroed rope probe in supports_op (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28995">#28995</a>)</p> <p>llama probes weight placement with a rope where all params are 0, so rejecting<br /> n_dims ==…
llama.cpp — Releases
TIER_1
(SO)
·
github-actions[bot]
·
2026-09-16 15:31
<details open=""> <p>model : add support for HrmTextForCausalLM (DFM Mimir 1B) (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/27625">#27625</a>)</p> <ul> <li>model : add support for HrmTextForCausalLM (DFM Mimir 1B)</li> </ul> <p>HRM-Text ru…
llama.cpp — Releases
TIER_1
(SO)
·
github-actions[bot]
·
2026-09-16 14:41
<details open=""> <p>CUDA/HIP: improve access patterns in im2col (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28013">#28013</a>)</p> </details> <p><strong>Website:</strong></p> <ul> <li><a href="https://llama.app" rel="nofollow">https://ll…
llama.cpp — Releases
TIER_1
(SO)
·
github-actions[bot]
·
2026-09-16 14:05
<details open=""> <p>spacemit : fix wrong transpose function for int16 data (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/25161">#25161</a>)</p> <p>The <code>sizeof(int16_t)</code> branch in <code>permute_transpose_impl</code> calls<br /> <…
llama.cpp — Releases
TIER_1
(SO)
·
github-actions[bot]
·
2026-09-16 13:10
<details open=""> <p>rpc : invalidate cached compute graph when a referenced buffer is freed (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/24292">#24292</a>)</p> <p>The server caches the most recent compute graph per device so that<br /> GR…