llama.cpp — Releases
TIER_1
(SO)
·
github-actions[bot]
·
2026-09-16 12:35
<details open=""> <p>Change max context length for auto-fitting with unified KV (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28849">#28849</a>)</p> </details> <p><strong>Website:</strong></p> <ul> <li><a href="https://llama.app" rel="nofol…
llama.cpp — Releases
TIER_1
(SO)
·
github-actions[bot]
·
2026-09-16 11:51
<details open=""> <p>qwen4exp: add hc ops (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28901">#28901</a>)</p> </details> <p><strong>Website:</strong></p> <ul> <li><a href="https://llama.app" rel="nofollow">https://llama.app</a></li> </ul> …
llama.cpp — Releases
TIER_1
(SO)
·
github-actions[bot]
·
2026-09-16 09:06
<details open=""> <p>HIP: broaden MoE ncols_opt tile heuristic on RDNA3.5 architecture (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28935">#28935</a>)</p> <p>It's found the MoE ncols_opt tile heuristic needs to be broadened<br /> to includ…
llama.cpp — Releases
TIER_1
(SO)
·
github-actions[bot]
·
2026-09-16 08:39
<details open=""> <p>chat : force <code>\n</think></code> on reasoning budget end for qwen3-coder (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28869">#28869</a>)</p> </details> <p><strong>Website:</strong></p> <ul> <li><a href="https…
llama.cpp — Releases
TIER_1
(SO)
·
github-actions[bot]
·
2026-09-16 08:01
<details open=""> <p>vulkan: make MUL_MAT_ID BN/2 tail unconditional (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28923">#28923</a>)</p> <p>Use BN/2 as the default for BNover2 and as the disabled fallback for BNover4, and remove the enable…
llama.cpp — Releases
TIER_1
(SO)
·
github-actions[bot]
·
2026-09-16 07:27
<details open=""> <p>metal: fix NaN in mul_mm_id when activations exceed f16 range (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/26223">#26223</a>)</p> <ul> <li>test-backend-ops: reproduce MUL_MAT_ID NaN for activations beyond f16</li> </ul…
llama.cpp — Releases
TIER_1
(SO)
·
github-actions[bot]
·
2026-09-16 06:56
<details open=""> <p>ci : add self-hosted webgpu to hf-jobs (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28712">#28712</a>)</p> <ul> <li> <p>add self-hosted vulkan and webgpu to hf-jobs</p> </li> <li> <p>try t4-medium</p> </li> <li> <p>con…
llama.cpp — Releases
TIER_1
(SO)
·
github-actions[bot]
·
2026-09-16 06:18
<details open=""> <p>llama-bench: support --version to print build info (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28971">#28971</a>)</p> </details> <p><strong>Website:</strong></p> <ul> <li><a href="https://llama.app" rel="nofollow">htt…
llama.cpp — Releases
TIER_1
(SO)
·
github-actions[bot]
·
2026-09-15 23:46
<details open=""> <p>hexagon: add back missing contiguous fast-path and hvx_copy_uu for each run (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28886">#28886</a>)</p> </details> <p><strong>Website:</strong></p> <ul> <li><a href="https://llam…
llama.cpp — Releases
TIER_1
(SO)
·
github-actions[bot]
·
2026-09-15 23:18
<details open=""> <p>hex-cpy: use dma if src and dst are contiguous (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28906">#28906</a>)</p> </details> <p><strong>Website:</strong></p> <ul> <li><a href="https://llama.app" rel="nofollow">https:/…
llama.cpp — Releases
TIER_1
(SO)
·
github-actions[bot]
·
2026-09-15 22:27
<details open=""> <p>HIP: Enable AllReduce for ROCm (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/27825">#27825</a>)</p> </details> <p><strong>Website:</strong></p> <ul> <li><a href="https://llama.app" rel="nofollow">https://llama.app</a></…
llama.cpp — Releases
TIER_1
(SO)
·
github-actions[bot]
·
2026-09-15 18:53
<details open=""> <p>opencl: choose the MoE expert matmul by batch size for speculative decoding/MTP (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/27637">#27637</a>)</p> <ul> <li> <p>opencl: gate the prebuilt q4_0 MoE GEMM on routing count<…
llama.cpp — Releases
TIER_1
(SO)
·
github-actions[bot]
·
2026-09-15 14:25
<details open=""> <p>rpc : hash-cache only weights (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28789">#28789</a>)</p> <ul> <li>rpc : hash-cache only weights</li> </ul> <p>ggml_backend_rpc_buffer_set_tensor and ggml_backend_rpc_set_tensor_…
llama.cpp — Releases
TIER_1
(SO)
·
github-actions[bot]
·
2026-09-15 13:46
<details open=""> <p>cuda: support row-contiguous SUM_ROWS (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/26308">#26308</a>)</p> <ul> <li> <p>cuda: support row-contiguous SUM_ROWS</p> </li> <li> <p>organize the code and add GGML_OP_MEAN to s…
llama.cpp — Releases
TIER_1
(SO)
·
github-actions[bot]
·
2026-09-15 13:13
<details open=""> <p>models : move build_arch_graph() after graph() template specialization (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28934">#28934</a>)</p> <p>Move build_arch_graph()'s function definitions after the graph<br /> and gra…
llama.cpp — Releases
TIER_1
(SO)
·
github-actions[bot]
·
2026-09-15 12:37
<details open=""> <p>vulkan: support sparse Flash Attention (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28105">#28105</a>)</p> <ul> <li> <p>vulkan: add sparse Flash Attention support for DSV4/GLM</p> </li> <li> <p>tune implementation</p> …
llama.cpp — Releases
TIER_1
(SO)
·
github-actions[bot]
·
2026-09-15 12:03
<details open=""> <p>OpenVINO: optimize stateful decode and GPU MoE inference (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28638">#28638</a>)</p> <ul> <li> <p>exclude GPU/NPU failing POOL_2D case</p> </li> <li> <p>Fix pool case</p> </li> <…
llama.cpp — Releases
TIER_1
(SO)
·
github-actions[bot]
·
2026-09-15 11:35
<details open=""> <p>opencl: add generic ssm_scan (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28881">#28881</a>)</p> <ul> <li> <p>opencl: add generic ssm_scan</p> </li> <li> <p>opencl: fix whitespace</p> </li> </ul> </details> <p><strong>…
llama.cpp — Releases
TIER_1
(SO)
·
github-actions[bot]
·
2026-09-15 11:02
<details open=""> <p>metal : add FA kernels for HSK=96, HSV=64 (MiniCPM3) (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28599">#28599</a>)</p> <ul> <li>metal : add FA kernels for HSK=96, HSV=64 (MiniCPM3)</li> </ul> <p>MiniCPM3 sets attenti…
llama.cpp — Releases
TIER_1
(SO)
·
github-actions[bot]
·
2026-09-15 10:10
<details open=""> <p>ci: Bump CUDA Windows x64 builds to 13.4.1 (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28930">#28930</a>)</p> </details> <p><strong>Website:</strong></p> <ul> <li><a href="https://llama.app" rel="nofollow">https://lla…
llama.cpp — Releases
TIER_1
(SO)
·
github-actions[bot]
·
2026-09-15 07:26
<details open=""> <p>ci : fix android release (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28936">#28936</a>)</p> </details> <p><strong>Website:</strong></p> <ul> <li><a href="https://llama.app" rel="nofollow">https://llama.app</a></li> </…
llama.cpp — Releases
TIER_1
(SO)
·
github-actions[bot]
·
2026-09-14 20:56
<details open=""> <p>HIP: fattn-mma: use fp32 accumulation on MFMA devices (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28576">#28576</a>)</p> <p>use fp32 accumulators in fattn-mma on CDNA</p> </details> <p><strong>Website:</strong></p> <u…
llama.cpp — Releases
TIER_1
(SO)
·
github-actions[bot]
·
2026-09-14 15:31
<details open=""> <p>llama.cpp : bump version to 0.4.1 (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28900">#28900</a>)</p> </details> <p><strong>Website:</strong></p> <ul> <li><a href="https://llama.app" rel="nofollow">https://llama.app</a…
llama.cpp — Releases
TIER_1
(CY)
·
ggerganov
·
2026-09-14 14:01
<p>llama.cpp : bump version to 0.4.1 (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28900">#28900</a>)</p>
llama.cpp — Releases
TIER_1
(SO)
·
github-actions[bot]
·
2026-09-14 14:00
<details open=""> <p>sycl: rfc: Use radix select for top_k (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28670">#28670</a>)</p> <ul> <li>sycl: GPU-resident TOP_K for large k, parallelised over the device</li> </ul> <p>The SYCL backend refus…
llama.cpp — Releases
TIER_1
(SO)
·
github-actions[bot]
·
2026-09-14 10:45
<details open=""> <p>ggml-cpu : disable PCH and fix CACHE_LINE_SIZE ambiguity to fix heap corruption (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28882">#28882</a>)</p> <p>Disable the ggml-cpu precompiled header and remove the<br /> std::h…
llama.cpp — Releases
TIER_1
(SO)
·
github-actions[bot]
·
2026-09-14 08:29
<details open=""> <p>sycl : fix oneDNN scratchpad breaking the pool free order (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28704">#28704</a>)</p> </details> <p><strong>Website:</strong></p> <ul> <li><a href="https://llama.app" rel="nofoll…
llama.cpp — Releases
TIER_1
(SO)
·
github-actions[bot]
·
2026-09-14 04:06
<details open=""> <p>common : move llama_n_rs_seq to before llama_decode (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28749">#28749</a>)</p> <p>This commit moves the llama_n_rs_seq function call to before the<br /> llama_decode call and re…
llama.cpp — Releases
TIER_1
(SO)
·
github-actions[bot]
·
2026-09-14 01:39
<details open=""> <p>ggml-cuda: fallback to F32 on device without BF16 hardware acceleration (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28846">#28846</a>)</p> <ul> <li> <p>ggml-cuda: fallback to F32 on device without BF16 hardware accele…
llama.cpp — Releases
TIER_1
(SO)
·
github-actions[bot]
·
2026-09-13 19:10
<details open=""> <p>tests : exclude HY_V4 from WebGPU test-llama-archs tests (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28855">#28855</a>)</p> <p>Co-authored-by: Stanisław Szymczyk <a href="mailto:[email protected] ">[email protected] <…
llama.cpp — Releases
TIER_1
(SO)
·
github-actions[bot]
·
2026-09-13 18:45
<details open=""> <p>models : guard the expert FFN size fallback in nemotron-h against a zero divisor (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28779">#28779</a>)</p> <p>The NextN/MTP tail loop derives the expert FFN size as n_ff/n_expe…
llama.cpp — Releases
TIER_1
(SO)
·
github-actions[bot]
·
2026-09-13 18:21
<details open=""> <p>ggml-cpu(s390x): guard VXE-only repack helpers (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28775">#28775</a>)</p> </details> <p><strong>Website:</strong></p> <ul> <li><a href="https://llama.app" rel="nofollow">https:/…
llama.cpp — Releases
TIER_1
(SO)
·
github-actions[bot]
·
2026-09-13 16:14
<details open=""> <p>sycl : Fix get mem error (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28227">#28227</a>)</p> <ul> <li> <p>fix for unsupport zes API</p> </li> <li> <p>optimize the code</p> </li> <li> <p>adjust the log level</p> </li> <…
llama.cpp — Releases
TIER_1
(SO)
·
github-actions[bot]
·
2026-09-13 10:36
<details open=""> <p>tests : reduce FA test sizes (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28842">#28842</a>)</p> </details> <p><strong>Website:</strong></p> <ul> <li><a href="https://llama.app" rel="nofollow">https://llama.app</a></li…
llama.cpp — Releases
TIER_1
(SO)
·
github-actions[bot]
·
2026-09-13 06:46
<details open=""> <p>vulkan: workaround NV queuesubmit driver bug (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28830">#28830</a>)</p> <p>There is a driver bug where two queues on the same VkDevice simultaneously<br /> submitting can break …
llama.cpp — Releases
TIER_1
(SO)
·
github-actions[bot]
·
2026-09-13 05:17
<details open=""> <p>opencl: apply the noshuffle row-alignment rule to q4_K, q5_K and q8_0, not just q6_K (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28575">#28575</a>)</p> </details> <p><strong>Website:</strong></p> <ul> <li><a href="htt…
llama.cpp — Releases
TIER_1
(SO)
·
github-actions[bot]
·
2026-09-13 01:09
<details open=""> <p>chat : improve parsing of complex types in qwen3-coder (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28742">#28742</a>)</p> <ul> <li> <p>chat : improve schema support in qwen3 parser</p> </li> <li> <p>cont : clean up gr…
llama.cpp — Releases
TIER_1
(SO)
·
github-actions[bot]
·
2026-09-13 00:41
<details open=""> <p>common: add LOG_JSON macro to log structured data (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28586">#28586</a>)</p> <ul> <li> <p>add LOG_JSON macro</p> </li> <li> <p>fit: add demo LOG_JSON</p> </li> </ul> </details> …
llama.cpp — Releases
TIER_1
(SO)
·
github-actions[bot]
·
2026-09-13 00:18
<details open=""> <p>common : implement common_schema internal representation for JSON schemas (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28736">#28736</a>)</p> <ul> <li> <p>common : implement common_schema types</p> </li> <li> <p>common…
llama.cpp — Releases
TIER_1
(SO)
·
github-actions[bot]
·
2026-09-12 23:37
<details open=""> <p>jinja : support dot property integer literals (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28817">#28817</a>)</p> </details> <p><strong>Website:</strong></p> <ul> <li><a href="https://llama.app" rel="nofollow">https://…
llama.cpp — Releases
TIER_1
(SO)
·
github-actions[bot]
·
2026-09-12 23:11
<details open=""> <p>cmake: leave the timestamp out of precompiled headers on clang (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28816">#28816</a>)</p> <p>Clang stores the modification time of the precompiled header sources<br /> inside th…
llama.cpp — Releases
TIER_1
(SO)
·
github-actions[bot]
·
2026-09-12 14:48
<details open=""> <p>ui : add cache (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28802">#28802</a>)</p> <p>Signed-off-by: Adrien Gallouët <a href="mailto:[email protected] ">[email protected] </a></p> </details> <p><strong>Website:</stro…
llama.cpp — Releases
TIER_1
(SO)
·
github-actions[bot]
·
2026-09-12 13:03
<details open=""> <p>server : allow model downloads at model limit fix issue <a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/issues/26809">#26809</a> (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28530">#2853…
llama.cpp — Releases
TIER_1
(SO)
·
github-actions[bot]
·
2026-09-12 12:30
<details open=""> <p>ggml-cuda: hip add specific config table for AMD GCN (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/27841">#27841</a>)</p> </details> <p><strong>Website:</strong></p> <ul> <li><a href="https://llama.app" rel="nofollow">h…
llama.cpp — Releases
TIER_1
(SO)
·
github-actions[bot]
·
2026-09-12 10:59
<details open=""> <p>vendor : update cpp-httplib to 0.56.0 (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28787">#28787</a>)</p> </details> <p><strong>Website:</strong></p> <ul> <li><a href="https://llama.app" rel="nofollow">https://llama.ap…
llama.cpp — Releases
TIER_1
(SO)
·
github-actions[bot]
·
2026-09-12 10:33
<details open=""> <p>syscl : Handle (fail gracefully) unsupported tq1_0 quants (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28681">#28681</a>)</p> </details> <p><strong>Website:</strong></p> <ul> <li><a href="https://llama.app" rel="nofoll…
llama.cpp — Releases
TIER_1
(SO)
·
github-actions[bot]
·
2026-09-12 09:20
<details open=""> <p>server: frame the router child state command as a whole line (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28747">#28747</a>)</p> <p>The child writes its state commands on stdout while the logger writes<br /> on stderr,…
llama.cpp — Releases
TIER_1
(SO)
·
github-actions[bot]
·
2026-09-12 08:58
<details open=""> <p>opencl: fix several bugs where the backend aborts (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/27630">#27630</a>)</p> </details> <p><strong>Website:</strong></p> <ul> <li><a href="https://llama.app" rel="nofollow">http…
llama.cpp — Releases
TIER_1
(SO)
·
github-actions[bot]
·
2026-09-12 08:32
<details open=""> <p>opencl: add bin kernel <code>kernel_gemm_noshuffle_q4_k_f32_32b_trans_ila_a8_bin</code> (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28677">#28677</a>)</p> <ul> <li> <p>opencl: add A8 Q4_K non-MoE binary kernel</p> </l…
llama.cpp — Releases
TIER_1
(SO)
·
github-actions[bot]
·
2026-09-12 08:06
<details open=""> <p>webgpu: align tensor bindings to the type block size (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28382">#28382</a>)</p> <p>Walk the binding offset back until the distance to the tensor is a<br /> whole number of block…
llama.cpp — Releases
TIER_1
(SO)
·
github-actions[bot]
·
2026-09-12 02:20
<details open=""> <p>ggml-webgpu: Update to a recent version of Dawn (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28683">#28683</a>)</p> <ul> <li> <p>ggml-webgpu: Update to a recent version of Dawn</p> </li> <li> <p>No module scanning</p> …
llama.cpp — Releases
TIER_1
(SO)
·
github-actions[bot]
·
2026-09-11 20:32
<details open=""> <p>cmake : skip PCH for llama-server PCH when using MSVC (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28763">#28763</a>)</p> <p>This commit fixes an issue that I introduced when adding PCH<br /> (precompiled headers) in C…
llama.cpp — Releases
TIER_1
(SO)
·
github-actions[bot]
·
2026-09-11 12:15
<details open=""> <p>metal : single-source fusion table + fusion debug rework (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28164">#28164</a>)</p> <ul> <li>metal : rework fusion patterns into a single table</li> </ul> <p>All fusable op patt…
llama.cpp — Releases
TIER_1
(SO)
·
github-actions[bot]
·
2026-09-11 11:46
<details open=""> <p>metal : fix idle threads in the remaining iq mul_mv kernels for ne00 < 1024 (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28692">#28692</a>)</p> <ul> <li>metal : fix idle threads in the remaining iq mul_mv kernels fo…
llama.cpp — Releases
TIER_1
(SO)
·
github-actions[bot]
·
2026-09-11 11:12
<details open=""> <p>model : fix MTP context kv cache allocation for deepseek2, glm4moe, … (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28630">#28630</a>)</p> <ul> <li> <p>model : fix MTP context kv cache allocation for deepseek2, glm4moe,…
llama.cpp — Releases
TIER_1
(SO)
·
github-actions[bot]
·
2026-09-11 10:41
<details open=""> <p>server: fix speculation after an image (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28715">#28715</a>)</p> <ul> <li>server: fix speculation after an image</li> </ul> <p>Pass the actual position to the drafter after an …
llama.cpp — Releases
TIER_1
(SO)
·
github-actions[bot]
·
2026-09-11 09:40
<details open=""> <p>CUDA/HIP: Flash Attention tuning (gfx1201) (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28102">#28102</a>)</p> <ul> <li>HIP: enable mma FA for head size 256 on RDNA4, tune configs</li> </ul> <p>Assisted-by: Claude<br /…
llama.cpp — Releases
TIER_1
(SO)
·
github-actions[bot]
·
2026-09-11 06:34
<details open=""> <p>vulkan: fix data race and OOB access in argsort(large) (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28705">#28705</a>)</p> <p>argsort had a data race in the inner loop, which VVL caught. But I don't think<br /> this wa…
llama.cpp — Releases
TIER_1
(SO)
·
github-actions[bot]
·
2026-09-10 22:42
<details open=""> <p>vulkan: use CPU writes in ggml_backend_vk_cpy_tensor_async if the context is idle (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28618">#28618</a>)</p> </details> <p><strong>Website:</strong></p> <ul> <li><a href="https:…
llama.cpp — Releases
TIER_1
(SO)
·
github-actions[bot]
·
2026-09-10 19:02
<details open=""> <p>vulkan: use add_alloc_dep to enable topk_moe fusion for prefill (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28422">#28422</a>)</p> </details> <p><strong>Website:</strong></p> <ul> <li><a href="https://llama.app" rel="…
llama.cpp — Releases
TIER_1
(SO)
·
github-actions[bot]
·
2026-09-10 18:35
<details open=""> <p>vulkan: small M matrix optimizations for qwen (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28457">#28457</a>)</p> <ul> <li> <p>vulkan: optimize m=1 mul_mat by swapping A/B</p> </li> <li> <p>vulkan: Improve small M perf…
llama.cpp — Releases
TIER_1
(SO)
·
shaofeiqi
·
2026-09-10 18:25
<p>opencl: add A8 Q4_0 mm binary kernel support (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28268">#28268</a>)</p>
llama.cpp — Releases
TIER_1
(SO)
·
github-actions[bot]
·
2026-09-10 18:01
<details open=""> <p>ci : Update WoA CUDA 13.4 release to use 13.4.1 GA redistributables (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28687">#28687</a>)</p> <ul> <li>Move Windows ARM64 CUDA 13.4 builds from the Developer Preview archives t…
llama.cpp — Releases
TIER_1
(SO)
·
github-actions[bot]
·
2026-09-10 15:45
<details open=""> <p>spec: fix failed to decode mtmd chunk with DFlash (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28587">#28587</a>)</p> <ul> <li>speculative: fix failed to decode mtmd chunk with DFlash</li> </ul> <p>When using DFlash w/…
llama.cpp — Releases
TIER_1
(SO)
·
github-actions[bot]
·
2026-09-10 13:54
<details open=""> <p>models: clean up some dead switch branches in old models (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28669">#28669</a>)</p> <p>Some of these if statements were copypastaed in a former refactor and<br /> never cleaned …
llama.cpp — Releases
TIER_1
(SO)
·
github-actions[bot]
·
2026-09-10 12:43
<details open=""> <p>tests : increase tolerance for Add fusion tests (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28691">#28691</a>)</p> </details> <p><strong>Website:</strong></p> <ul> <li><a href="https://llama.app" rel="nofollow">https:…
llama.cpp — Releases
TIER_1
(SO)
·
github-actions[bot]
·
2026-09-10 11:56
<details open=""> <p>tests : drop SYCL special-casing in test-backend-ops.cpp (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28688">#28688</a>)</p> </details> <p><strong>Website:</strong></p> <ul> <li><a href="https://llama.app" rel="nofollo…
llama.cpp — Releases
TIER_1
(SO)
·
github-actions[bot]
·
2026-09-10 11:27
<details open=""> <p>vulkan: fall back to shared-memory reduction for dmmv on PowerVR (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28341">#28341</a>)</p> <p>The Imagination proprietary Vulkan compiler returns VK_ERROR_UNKNOWN from<br /> vk…
llama.cpp — Releases
TIER_1
(SO)
·
github-actions[bot]
·
2026-09-10 10:06
<details open=""> <p>memory : avoid allocating V cache for indexer (it's not used) (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28330">#28330</a>)</p> <p>Co-authored-by: Stanisław Szymczyk <a href="mailto:[email protected] ">sszymczy@gmail…
llama.cpp — Releases
TIER_1
(SO)
·
github-actions[bot]
·
2026-09-10 09:41
<details open=""> <p>vulkan : add command-buffer debug labels for GPU profilers (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28101">#28101</a>)</p> <ul> <li>vulkan : add command-buffer debug labels for GPU profilers</li> </ul> <p>Co-author…
llama.cpp — Releases
TIER_1
(SO)
·
github-actions[bot]
·
2026-09-10 09:09
<details open=""> <p>ggml-cpu(s390x): add repack support for q4_0 (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28667">#28667</a>)</p> <p>ggml-cpu: clean comments</p> <p>Signed-off-by: Aaron Teo <a href="mailto:[email protected] ">aaron.teo…
llama.cpp — Releases
TIER_1
(SO)
·
github-actions[bot]
·
2026-09-10 08:36
<details open=""> <p>ggml-cpu(s390x): add Q1_0 vector intrinsic support (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28606">#28606</a>)</p> <ul> <li>ggml-cpu: add <code>ggml_vec_dot_q1_0_q8_0</code> support</li> </ul> <p>Signed-off-by: Aar…
llama.cpp — Releases
TIER_1
(SO)
·
github-actions[bot]
·
2026-09-10 07:53
<details open=""> <p>model: fix all granite family parameter counts (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28643">#28643</a>)</p> <ul> <li>model: fix all granite family parameter counts</li> </ul> <p>Signed-off-by: Aaron Teo <a href=…
llama.cpp — Releases
TIER_1
(SO)
·
netrunnereve
·
2026-09-09 19:46
<p>ci: fix sanitizer tests (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28583">#28583</a>)</p>
llama.cpp — Releases
TIER_1
(SO)
·
github-actions[bot]
·
2026-09-09 17:32
<details open=""> <p>vulkan: use spec constant for matrix matrix multiplication A-type (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/25773">#25773</a>)</p> <ul> <li>vulkan: use spec constant for mul mat type_a</li> </ul> <p>vulkan: use map …
llama.cpp — Releases
TIER_1
(SO)
·
github-actions[bot]
·
2026-09-09 15:34
<details open=""> <p>vulkan: Convert FILL to distribute workgroups in 2D to avoid exceeding maxComputeWorkGroupCount (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28592">#28592</a>)</p> <ul> <li>divide workload to 2D</li> </ul> <p>This is t…
llama.cpp — Releases
TIER_1
(SO)
·
github-actions[bot]
·
2026-09-09 13:25
<details open=""> <p>llama : use int32_t for llama_sampler_chain_n return type (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28631">#28631</a>)</p> <p>Contributes to <a class="issue-link js-issue-link" href="https://github.com/ggml-org/llam…
llama.cpp — Releases
TIER_1
(SO)
·
github-actions[bot]
·
2026-09-09 12:55
<details open=""> <p>CUDA: size routed MoE MMQ N-tiles from typical expert width on RDNA3 (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28552">#28552</a>)</p> <p>Recreated from <a class="issue-link js-issue-link" href="https://github.com/gg…
llama.cpp — Releases
TIER_1
(SO)
·
github-actions[bot]
·
2026-09-09 11:47
<details open=""> <p>CUDA: replace GGML_FA_ALL_QUANTS with GGML_FA_QUANTS, more control over what is compiled (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28079">#28079</a>)</p> <ul> <li>CUDA: add configurable FA quant combinations</li> </…
llama.cpp — Releases
TIER_1
(SO)
·
github-actions[bot]
·
2026-09-09 11:17
<details open=""> <p>args: officially deprecate --mmap|mlock|dio (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28334">#28334</a>)</p> <p>Signed-off-by: Aaron Teo <a href="mailto:[email protected] ">[email protected] </a></p> </details> <p><…
llama.cpp — Releases
TIER_1
(SO)
·
github-actions[bot]
·
2026-09-09 09:56
<details open=""> <p>model: fix granite3 moe unknown parameter count (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28632">#28632</a>)</p> <p>Signed-off-by: Aaron Teo <a href="mailto:[email protected] ">[email protected] </a></p> </details> …
llama.cpp — Releases
TIER_1
(SO)
·
github-actions[bot]
·
2026-09-09 09:24
<details open=""> <p>mtmd: propagate video ID to bitmap (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28601">#28601</a>)</p> </details> <p><strong>Website:</strong></p> <ul> <li><a href="https://llama.app" rel="nofollow">https://llama.app</…
llama.cpp — Releases
TIER_1
(SO)
·
github-actions[bot]
·
2026-09-09 07:47
<details open=""> <p>jinja: treat a null left operand of in as a plain lookup (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28620">#28620</a>)</p> <p>Templates that default an optional variable to none and then test its<br /> membership in …
llama.cpp — Releases
TIER_1
(SO)
·
github-actions[bot]
·
2026-09-09 07:20
<details open=""> <p>vulkan: add dedicated iq4_xs mat-vec shader (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28426">#28426</a>)</p> <ul> <li>vulkan: add dedicated iq4_xs mat-vec shader</li> </ul> <p>Dedicated mul_mat_vec_iq4_xs for the dm…
llama.cpp — Releases
TIER_1
(SO)
·
github-actions[bot]
·
2026-09-09 06:40
<details open=""> <p>vulkan: add f16 B-type matmul pipelines and warp tile size tuning for Intel coopmat1 (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/27471">#27471</a>)</p> <ul> <li> <p>vulkan: add f16 B-type matmul pipelines and warp til…
llama.cpp — Releases
TIER_1
(SO)
·
github-actions[bot]
·
2026-09-09 05:27
<details open=""> <p>tests : use less threads for data initialization (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28325">#28325</a>)</p> <ul> <li> <p>tests : use 1 thread for data initialization</p> </li> <li> <p>cont : scale threads with…
llama.cpp — Releases
TIER_1
(SO)
·
github-actions[bot]
·
2026-09-09 02:03
<details open=""> <p>Add IQ type handling for MoE (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28476">#28476</a>)</p> <p>Co-authored-by: cwriter <a href="mailto:cwriter@localhost">cwriter@localhost</a></p> </details> <p><strong>Website:</s…
llama.cpp — Releases
TIER_1
(SO)
·
github-actions[bot]
·
2026-09-08 17:33
<details open=""> <p>llama: disable lazy tensor loading by default on iGPUs (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28326">#28326</a>)</p> <ul> <li> <p>llama: add lazy mode auto, fix iGPU regression</p> </li> <li> <p>revert changes ex…
llama.cpp — Releases
TIER_1
(SO)
·
github-actions[bot]
·
2026-09-08 15:14
<details open=""> <p>Revert "ggml-cuda : restore prop.integrated on HIP builds (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/24233">#24233</a>)" (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28604">#2…
llama.cpp — Releases
TIER_1
(SO)
·
github-actions[bot]
·
2026-09-08 14:33
<details open=""> <p>server : apply checkpoint min-step eviction only when the checkpoint list is full (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28302">#28302</a>)</p> <p>The spacing eviction in create_checkpoint() keeps the oldest chec…
llama.cpp — Releases
TIER_1
(SO)
·
github-actions[bot]
·
2026-09-08 14:01
<details open=""> <p>metal : fix idle threads in mul_mv_iq3_xxs for ne00 < 1024 (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28086">#28086</a>)</p> <ul> <li> <p>metal : fix half-idle simdgroup in kernel_mul_mv_iq3_xxs_f32 for ne00 < …
llama.cpp — Releases
TIER_1
(SO)
·
github-actions[bot]
·
2026-09-08 12:36
<details open=""> <p>llama : add missing headers (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28566">#28566</a>)</p> <ul> <li>fix compile-error: add missing header</li> </ul> <p>Bug: <a class="issue-link js-issue-link" href="https://github…
llama.cpp — Releases
TIER_1
(SO)
·
github-actions[bot]
·
2026-09-08 12:08
<details open=""> <p>vulkan : fuse UNARY(GELU|SIGMOID|SILU|SOFTPLUS) + MUL (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/27220">#27220</a>)</p> <ul> <li> <p>vulkan : fuse UNARY(SIGMOID|SILU|SOFTPLUS) + MUL</p> </li> <li> <p>vulkan : fuse UN…
llama.cpp — Releases
TIER_1
(SO)
·
github-actions[bot]
·
2026-09-08 11:38
<details open=""> <p>Fix Vulkan-Hpp handle usage on 32-bit targets. (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/22892">#22892</a>)</p> <p>On 32-bit platforms, Vulkan non-dispatchable handles such as VkBuffer are<br /> represented as uint6…
llama.cpp — Releases
TIER_1
(SO)
·
github-actions[bot]
·
2026-09-08 10:50
<details open=""> <p>chat : split specialized parsers into common/parsers (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/27764">#27764</a>)</p> <ul> <li>chat : split specialized parsers into common/parsers</li> </ul> <p>Move the 14 dedicated…
llama.cpp — Releases
TIER_1
(SO)
·
github-actions[bot]
·
2026-09-08 10:06
<details open=""> <p>opencl: properly handle non-contiguous inputs to conv2d (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28503">#28503</a>)</p> <ul> <li> <p>opencl: fix conv2d non-contiguous strides</p> </li> <li> <p>opencl: format</p> </…
llama.cpp — Releases
TIER_1
(SO)
·
github-actions[bot]
·
2026-09-08 04:00
<details open=""> <p>model : support Kimi-K3 recurrent-state rollback (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28466">#28466</a>)</p> </details> <p><strong>Website:</strong></p> <ul> <li><a href="https://llama.app" rel="nofollow">https…
llama.cpp — Releases
TIER_1
(SO)
·
github-actions[bot]
·
2026-09-08 00:42
<details open=""> <p>hexagon: add RELU and LEAKY_RELU ops (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28585">#28585</a>)</p> <ul> <li> <p>hexagon: add RELU op</p> </li> <li> <p>hexagon: add LEAKY_RELU op too</p> </li> </ul> </details> <p>…
llama.cpp — Releases
TIER_1
(SO)
·
github-actions[bot]
·
2026-09-07 20:05
<details open=""> <p>tests : initialize the L2_NORM batch array (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28553">#28553</a>)</p> <ul> <li>tests: bind the L2_NORM batch count to a local</li> </ul> <p>GCC cannot prove the loop fills norms…
llama.cpp — Releases
TIER_1
(SO)
·
github-actions[bot]
·
2026-09-07 19:30
<details open=""> <p>vulkan: add DeepSeek-V4 hyper-connection fused ops (DSV4_HC_COMB/PRE/POST) (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/26578">#26578</a>)</p> <ul> <li>vulkan: add DeepSeek-V4 hyper-connection fused ops (DSV4_HC_COMB/P…
llama.cpp — Releases
TIER_1
(SO)
·
github-actions[bot]
·
2026-09-07 18:16
<details open=""> <p>ggml: add gfx90c HIP support (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/26454">#26454</a>)</p> <ul> <li> <p>ggml: add gfx90c HIP support</p> </li> <li> <p>ggml: make gfx90c HIP support compliant with specifications</…
llama.cpp — Releases
TIER_1
(SO)
·
github-actions[bot]
·
2026-09-07 14:33
<details open=""> <p>CUDA: branchless Q4_K/Q5_K unpack to speed up mmvq, L2 prefetch on DGX Spark (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/26705">#26705</a>)</p> <ul> <li> <p>Update Q4_K and Q5_K to use branchless computation, which st…
llama.cpp — Releases
TIER_1
(SO)
·
github-actions[bot]
·
2026-09-07 11:16
<details open=""> <p>vulkan: support type-aligned GET_ROWS (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28253">#28253</a>)</p> <ul> <li>vulkan: fall back to CPU for GET_ROWS with misaligned offsets</li> </ul> <p>The Vulkan GET_ROWS shader …
llama.cpp — Releases
TIER_1
(SO)
·
github-actions[bot]
·
2026-09-07 08:37
<details open=""> <p>caps : recheck typed content if template checks for string (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28511">#28511</a>)</p> </details> <p><strong>Website:</strong></p> <ul> <li><a href="https://llama.app" rel="nofol…
llama.cpp — Releases
TIER_1
(SO)
·
github-actions[bot]
·
2026-09-07 08:11
<details open=""> <p>ggml-cuda: fix divergent barrier in f16 flash attention (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/27870">#27870</a>)</p> <ul> <li> <p>ggml-cuda: fix divergent barrier in f16 flash attention</p> </li> <li> <p>ggml-cu…
llama.cpp — Releases
TIER_1
(SO)
·
github-actions[bot]
·
2026-09-07 07:20
<details open=""> <p>ggml: allow backend inputs to not create another split (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28387">#28387</a>)</p> </details> <p><strong>Website:</strong></p> <ul> <li><a href="https://llama.app" rel="nofollow"…
llama.cpp — Releases
TIER_1
(SO)
·
github-actions[bot]
·
2026-09-07 06:51
<details open=""> <p>vulkan: rms_norm fusion opportunities (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28024">#28024</a>)</p> <p>Support RMS_NORM + MUL + ADD (+ MUL) and RMS_NORM + VIEW + SET_ROWS.<br /> Extend ROPE + VIEW + SET_ROWS to s…
llama.cpp — Releases
TIER_1
(SO)
·
github-actions[bot]
·
2026-09-07 05:21
<details open=""> <p>vulkan: add TQ1_0 support (mm, mat-vec, mat-vec-id, dequant, get_rows) (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/27765">#27765</a>)</p> <ul> <li> <p>vulkan: add TQ1_0 support (mm, mat-vec, dequant, get_rows)</p> </l…
llama.cpp — Releases
TIER_1
(SO)
·
github-actions[bot]
·
2026-09-06 23:30
<details open=""> <p>convert : add <code>--fuse-qkv</code> flag to fuse Q/K/V into QKV during HF-to-GGUF conversion (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/22780">#22780</a>)</p> </details> <p><strong>Website:</strong></p> <ul> <li><a…
llama.cpp — Releases
TIER_1
(SO)
·
github-actions[bot]
·
2026-09-06 23:06
<details open=""> <p>models : fix GDN normalization from <code>max</code> to <code>rsqrt</code> (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28068">#28068</a>)</p> <ul> <li>models: use flash-linear-attention's l2norm for gated delta net q/…
llama.cpp — Releases
TIER_1
(SO)
·
github-actions[bot]
·
2026-09-06 22:11
<details open=""> <p>[Model] Support for Spark2_5ForCausalLM implementation (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/27868">#27868</a>)</p> <ul> <li>Add Spark3 Model</li> <li>rename spark3 -> spark2_5</li> </ul> <p>Co-authored-by: S…
llama.cpp — Releases
TIER_1
(SO)
·
github-actions[bot]
·
2026-09-06 20:52
<details open=""> <p>opencl: properly choose weights pack for q4_K, q5_K mul_mat (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28402">#28402</a>)</p> </details> <p><strong>Website:</strong></p> <ul> <li><a href="https://llama.app" rel="nofo…
llama.cpp — Releases
TIER_1
(SO)
·
github-actions[bot]
·
2026-09-06 16:42
<details open=""> <p>cuda: fixes races in mmid and mmf (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28475">#28475</a>)</p> </details> <p><strong>Website:</strong></p> <ul> <li><a href="https://llama.app" rel="nofollow">https://llama.app</a…
llama.cpp — Releases
TIER_1
(SO)
·
github-actions[bot]
·
2026-09-06 13:24
<details open=""> <p>grammar : fix max repetition threshold (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28469">#28469</a>)</p> </details> <p><strong>Website:</strong></p> <ul> <li><a href="https://llama.app" rel="nofollow">https://llama.a…
llama.cpp — Releases
TIER_1
(SO)
·
github-actions[bot]
·
2026-09-06 11:59
<details open=""> <p>common: add --log-jsonl (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28437">#28437</a>)</p> <ul> <li> <p>common: add --log-jsonl</p> </li> <li> <p>rename unknown to none</p> </li> </ul> </details> <p><strong>Website:</…
llama.cpp — Releases
TIER_1
(SO)
·
github-actions[bot]
·
2026-09-06 11:32
<details open=""> <p>ui : embed assets directly with CMake (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28445">#28445</a>)</p> <p>Remove the build-time C++ helper and external gzip dependency,<br /> simplifying cross-compilation. Keep the …
llama.cpp — Releases
TIER_1
(SO)
·
github-actions[bot]
·
2026-09-06 10:01
<details open=""> <p>metal : add remaining fa-vec tunings for M2 Max (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28458">#28458</a>)</p> </details> <p><strong>Website:</strong></p> <ul> <li><a href="https://llama.app" rel="nofollow">https:…
llama.cpp — Releases
TIER_1
(SO)
·
JohannesGaessler
·
2026-09-05 20:42
<p>Github: limit blank issues to maintainers (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28435">#28435</a>)</p>
llama.cpp — Releases
TIER_1
(SO)
·
github-actions[bot]
·
2026-09-05 10:38
<details open=""> <p>metal : fix memory leak in early return (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28399">#28399</a>)</p> </details> <p><strong>Website:</strong></p> <ul> <li><a href="https://llama.app" rel="nofollow">https://llama.…
llama.cpp — Releases
TIER_1
(SO)
·
github-actions[bot]
·
2026-09-05 09:28
<details open=""> <p>sycl: attribute device allocations by site (GGML_SYCL_MEMTRACE) (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/27631">#27631</a>)</p> <p>define two new environment variables to better understand how much<br /> memory is …
llama.cpp — Releases
TIER_1
(SO)
·
philip-jingxin
·
2026-09-05 02:37
<p>sycl : fix test-backend-ops CI break && restore Kronecker product FWH…</p>
llama.cpp — Releases
TIER_1
(SO)
·
github-actions[bot]
·
2026-09-04 20:00
<details open=""> <p>metal : add remaining fa-vec tunings for M3 (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28396">#28396</a>)</p> <ul> <li> <p>addition of m3 in fa_vec_tuned_table</p> </li> <li> <p>adding q4_0,q4_1,q5_0,q5_1 in ggml-met…
llama.cpp — Releases
TIER_1
(SO)
·
github-actions[bot]
·
2026-09-04 19:32
<details open=""> <p>opencl: extend the elementwise and data‐movement op coverage (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/27633">#27633</a>)</p> <ul> <li>opencl: add extended elementwise unary ops (sgn, step, elu, hardswish, hardsigmo…
llama.cpp — Releases
TIER_1
(SO)
·
github-actions[bot]
·
2026-09-04 19:05
<details open=""> <p>opencl: add Adreno xmem SDPA path (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/26331">#26331</a>)</p> <ul> <li>opencl: add Adreno xmem SDPA path</li> </ul> <p>Assisted-by: Codex</p> <ul> <li> <p>Removed the Adreno-spec…
llama.cpp — Releases
TIER_1
(SO)
·
github-actions[bot]
·
2026-09-04 17:57
<details open=""> <p>llama.cpp : bump version to 0.4.0 (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28386">#28386</a>)</p> </details> <p><strong>Website:</strong></p> <ul> <li><a href="https://llama.app" rel="nofollow">https://llama.app</a…