llama.cpp 发布多个更新，支持跨平台优化

llama.cpp — Releases TIER_1 (SO) · github-actions[bot] · 2026-07-27 00:22

b10142

<details open=""> mtmd: Add Vision Support for Minimax-M3 (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/25113">#25113</a>) <ul> <li>Add preliminary MiniMax-M3 support</li> </ul> Text-only port that re-uses existing components: Min…

llama.cpp — Releases TIER_1 (SO) · github-actions[bot] · 2026-07-26 23:05

b10141

<details open=""> mtmd: fix android build (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/26150">#26150</a>) </details> Website: <ul> <li><a href="https://llama.app" rel="nofollow">https://llama.app</a></li> </u…

llama.cpp — Releases TIER_1 (SO) · ServeurpersoCom · 2026-07-26 04:51

b10133

ui: fix context gauge card regressions and land at the conversation e…

llama.cpp — Releases TIER_1 (SO) · github-actions[bot] · 2026-07-24 14:02

b10107

<details open=""> hexagon: fix Windows crash when op_poll is enabled (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/26029">#26029</a>) </details> Website: <ul> <li><a href="https://llama.app" rel="nofollow">htt…

llama.cpp — Releases TIER_1 (SO) · github-actions[bot] · 2026-07-24 11:36

b10106

<details open=""> CUDA: fix external compilation of q1_0 MMQ (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/25778">#25778</a>) </details> Website: <ul> <li><a href="https://llama.app" rel="nofollow">https://lla…

llama.cpp — Releases TIER_1 (SO) · github-actions[bot] · 2026-07-24 09:35

b10105

<details open=""> args: refactor mlock/mmap/directio into load-mode (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/20834">#20834</a>) <ul> <li>args: overhaul mmap/mlock/dio into single arg</li> </ul> Signed-off-by: Aaron Teo <a hre…

llama.cpp — Releases TIER_1 (SO) · max-krasnyansky · 2026-07-24 02:13

b10108

hexagon: further improved pipeline of the core bits (L2, DMA, MM, FA)…

llama.cpp — Releases TIER_1 (SO) · github-actions[bot] · 2026-07-23 23:35

b10099

<details open=""> CUDA: Improve NVFP4 W4A4 activation quantization (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/25730">#25730</a>) <ul> <li>Squash history before conflict-resolution during rebase on master</li> </ul> WIP commit</…

llama.cpp — Releases TIER_1 (SO) · github-actions[bot] · 2026-07-23 20:13

b10098

<details open=""> hexagon: activation ops update (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/25974">#25974</a>) <ul> <li> hex-geglu: optimized all-in-one geglu microkernel </li> <li> hex-geglu: enable non-contiguous src a…

llama.cpp — Releases TIER_1 (SO) · github-actions[bot] · 2026-07-23 18:29

b10094

<details open=""> common: infer the speculative type from the draft repo sidecars (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/25989">#25989</a>) With -hfd pointing to a repo that ships mtp-/dflash-/eagle3- sidecars and no …

llama.cpp — Releases TIER_1 (SO) · github-actions[bot] · 2026-07-23 17:21

b10093

<details open=""> Fix DeepSeek4 crafted template (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/25414">#25414</a>) <ul> <li> chat: fix DS4 template to explicitly follow reference behavior </li> <li> Support DeepSeekv4 flag (…

llama.cpp — Releases TIER_1 (SO) · github-actions[bot] · 2026-07-23 05:32

b10092

<details open=""> ggml: enable PowerPC backend variants on AIX (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/25983">#25983</a>) <ul> <li>ggml: enable PowerPC backend variants on AIX</li> </ul> Allow the PowerPC CPU backend variant…

llama.cpp — Releases TIER_1 (SO) · iliailmer · 2026-07-23 03:45

b10103

metal : add f16 type support to leaky relu (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/25981">#25981</a>)

llama.cpp — Releases TIER_1 (SO) · github-actions[bot] · 2026-07-22 21:13

b10091

<details open=""> ci : fix SYCL package shared library lookup (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/25987">#25987</a>) </details> Website: <ul> <li><a href="https://llama.app" rel="nofollow">https://ll…

llama.cpp — Releases TIER_1 (SO) · github-actions[bot] · 2026-07-22 20:25

b10090

<details open=""> webgpu : add CONV_2D_DW (depthwise conv2d) kernel (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/25847">#25847</a>) <ul> <li>webgpu : add CONV_2D_DW (depthwise conv2d) kernel</li> </ul> Implement GGML_OP_CONV_2D_D…

llama.cpp — Releases TIER_1 (SO) · github-actions[bot] · 2026-07-22 19:47

b10089

<details open=""> cuda: GET_ROWS quants (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/25962">#25962</a>) <ul> <li>cuda: add k-quant support to GET_ROWS</li> </ul> Device-side embedding lookups require GET_ROWS to handle the k-quan…

llama.cpp — Releases TIER_1 (SO) · github-actions[bot] · 2026-07-22 11:05

b10087

<details open=""> Add support for Laguna XS.2 & M.1 (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/25165">#25165</a>) </details> Website: <ul> <li><a href="https://llama.app" rel="nofollow">https://llama.ap…

llama.cpp — Releases TIER_1 (SO) · github-actions[bot] · 2026-07-22 09:54

b10085

<details open=""> mtmd : use align_corners for qwen3vl vision position embedding interpolation (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/25781">#25781</a>) The Qwen3-VL learned position embedding is interpolated to the runtime…

llama.cpp — Releases TIER_1 (SO) · github-actions[bot] · 2026-07-22 09:14

b10084

<details open=""> hexagon: check tensor type when reusing descriptors (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/25968">#25968</a>) </details> Website: <ul> <li><a href="https://llama.app" rel="nofollow">ht…

llama.cpp — Releases TIER_1 (SO) · github-actions[bot] · 2026-07-22 08:35

b10083

<details open=""> cuda: add sqrt_softplus in topk-moe for dsv4 (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/25896">#25896</a>) </details> Website: <ul> <li><a href="https://llama.app" rel="nofollow">https://l…

llama.cpp — Releases TIER_1 (SO) · github-actions[bot] · 2026-07-22 06:29

b10082

<details open=""> kleidiai : warn once when a weight type has no KleidiAI kernel (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/25701">#25701</a>) </details> Website: <ul> <li><a href="https://llama.app" rel="n…

llama.cpp — Releases TIER_1 (SO) · github-actions[bot] · 2026-07-22 05:44

b10081

<details open=""> common: resolve draft repo to its requested sidecar (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/25955">#25955</a>) With -hfd pointing to a repo shipping speculative sidecars, the draft resolved to the mai…

llama.cpp — Releases TIER_1 (SO) · github-actions[bot] · 2026-07-22 05:07

b10080

<details open=""> server: return 400 instead of 500 on validation error with X-Conversation-Id (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/25760">#25760</a>) <ul> <li>server: return 400 instead of 500 on validation error with X-Con…

llama.cpp — Releases TIER_1 (SO) · helanfxz · 2026-07-22 02:55

b10088

llama-arch: fix DeepSeek4 APE tensor op (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/25945">#25945</a>)

llama.cpp — Releases TIER_1 (SO) · github-actions[bot] · 2026-07-22 02:05

b10079

<details open=""> server : properly handle null llama_context (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/25868">#25868</a>) Co-authored-by: Stanisław Szymczyk <a href="mailto:[email protected]">[email protected]</a> </det…

llama.cpp — Releases TIER_1 (SO) · github-actions[bot] · 2026-07-21 22:40

b10078

<details open=""> vulkan: Refactor vk_queue to use per-instance mutexes and unique handles (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/23570">#23570</a>) <ul> <li> Refactor vk_queue to use per-instance mutexes and unique handles…

llama.cpp — Releases TIER_1 (SO) · github-actions[bot] · 2026-07-21 21:55

b10077

<details open=""> ggml-openvino: Add GGML_BACKEND_DL_IMPL invocation for OpenVINO backend (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/25795">#25795</a>) This adds the missing <code>GGML_BACKEND_DL_IMPL()</code> macro invocation,…

llama.cpp — Releases TIER_1 (SO) · github-actions[bot] · 2026-07-21 15:54

b10076

<details open=""> CUDA: vectorize same-type get_rows with int4 copy (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/25929">#25929</a>) k_get_rows_float did a scalar one-element-per-thread copy and recomputed the row-invariant …

llama.cpp — Releases TIER_1 (SO) · github-actions[bot] · 2026-07-20 06:31

b10069

<details open=""> opencl: Support broadcast for Adreno MUL_MAT and honor <code>view_offs</code> for Adreno Q8_0 MUL_MAT for llama-server multi-stream (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/25910">#25910</a>) <ul> <li> openc…

llama.cpp — Releases TIER_1 (SO) · github-actions[bot] · 2026-07-18 13:38

b10068

<details open=""> model: rotate injected K/V cache for DFlash (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/25823">#25823</a>) <ul> <li> dflash: rotate injected K/V cache when using K/V quantization </li> <li> Update src/mo…

llama.cpp — Releases TIER_1 (SO) · github-actions[bot] · 2026-07-18 12:14

b10067

<details open=""> llama-quant : exclude i32 ffn_gate_tid2eid routing table from quantization (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/25787">#25787</a>) DeepSeek-V4's ffn_gate_tid2eid tensor is an i32 token-id -> expert-id…

llama.cpp — Releases TIER_1 (SO) · github-actions[bot] · 2026-07-17 23:13

b10066

<details open=""> opencl: load and use <code>kernel_gemm_moe_q6_k_f32_ns</code> from bin kernel lib (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/25797">#25797</a>) </details> Website: <ul> <li><a href="https:…

llama.cpp — Releases TIER_1 (SO) · github-actions[bot] · 2026-07-17 15:42

b10064

<details open=""> opencl: transpose q4_K noshuffle scales for coalesced reads (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/25805">#25805</a>) </details> Website: <ul> <li><a href="https://llama.app" rel="nofo…

llama.cpp — Releases TIER_1 (SO) · github-actions[bot] · 2026-07-17 15:00

b10063

<details open=""> sync : ggml </details> Website: <ul> <li><a href="https://llama.app" rel="nofollow">https://llama.app</a></li> </ul> macOS/iOS: <ul> <li><a href="https://github.com/ggml-org/llama.cpp/releases/download/b1006…

llama.cpp — Releases TIER_1 (SO) · github-actions[bot] · 2026-07-17 14:20

b10061

<details open=""> tests : initialize all tensors in test_dsv4_hc to avoid NaNs in sentinel tensors (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/25822">#25822</a>) Co-authored-by: Stanisław Szymczyk <a href="mailto:sszymczy@gmail.…

llama.cpp — Releases TIER_1 (SO) · github-actions[bot] · 2026-07-17 12:24

b10059

<details open=""> ggml-blas: default hadamard mul_mat to cpu routine (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/25710">#25710</a>) Signed-off-by: Aaron Teo <a href="mailto:[email protected]">[email protected]</a> </detail…

llama.cpp — Releases TIER_1 (SO) · github-actions[bot] · 2026-07-17 11:45

b10058

<details open=""> vulkan: Support Q2_0 (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/25430">#25430</a>) <ul> <li>vulkan: Support Q2_0</li> </ul> The backend perf tests for mat-vec-mul weren't very good at first (worse than q…

llama.cpp — Releases TIER_1 (SO) · github-actions[bot] · 2026-07-17 10:24

b10057

<details open=""> sycl: fix row calculation when K_QUANTS_PER_ITERATION is 1 (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/25690">#25690</a>) <ul> <li>sycl: fix incorrect row calculation when K_QUANTS_PER_ITERATION=1</li> </ul> Si…

llama.cpp — Releases TIER_1 (SO) · Gezahegne · 2026-07-17 05:13

b10056

opencl: add ABS op (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/25115">#25115</a>)

llama.cpp — Releases TIER_1 (SO) · github-actions[bot] · 2026-07-17 00:30

b10054

<details open=""> docs: added a note about using OpenCl with Adreno 810 (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/25786">#25786</a>) </details> Website: <ul> <li><a href="https://llama.app" rel="nofollow">…

llama.cpp — Releases TIER_1 (SO) · github-actions[bot] · 2026-07-16 21:25

b10052

<details open=""> hexagon: L2 cache handling rework (dirty bit tracking with lazy flushing) and more MUL_MAT updates (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/25762">#25762</a>) <ul> <li> hex-mm: fix artificial limit in the so…

llama.cpp — Releases TIER_1 (SO) · github-actions[bot] · 2026-07-16 20:51

b10051

<details open=""> kleidiai: Add SME vs SME2 distinction in kernel dispatch (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/25478">#25478</a>) The current integration treats SME as a single capability (CPU_FEATURE_SME) with no …

llama.cpp — Releases TIER_1 (SO) · github-actions[bot] · 2026-07-16 20:10

b10050

<details open=""> vulkan: when using transfer queue for async copies, sync on event_wait to avoid race (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/25229">#25229</a>) </details> Website: <ul> <li><a href="htt…

llama.cpp — Releases TIER_1 (SO) · github-actions[bot] · 2026-07-16 19:24

b10048

<details open=""> TP: fix Phi3, Bert, Plamo2/3, ChatGLM (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/25536">#25536</a>) </details> Website: <ul> <li><a href="https://llama.app" rel="nofollow">https://llama.ap…

llama.cpp — Releases TIER_1 (SO) · github-actions[bot] · 2026-07-16 18:46

b10047

<details open=""> vendor: update BoringSSL to 0.20260713.0 (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/25624">#25624</a>) </details> Website: <ul> <li><a href="https://llama.app" rel="nofollow">https://llama…

llama.cpp — Releases TIER_1 (SO) · github-actions[bot] · 2026-07-16 17:08

b10046

<details open=""> tests: actually exercise <code>test-recurrent-state-rollback</code> (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/25758">#25758</a>) </details> Website: <ul> <li><a href="https://llama.app" r…

llama.cpp — Releases TIER_1 (SO) · github-actions[bot] · 2026-07-16 16:11

b10045

<details open=""> server : allow text-only slot save/restore with mtmd (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/25076">#25076</a>) </details> Website: <ul> <li><a href="https://llama.app" rel="nofollow">h…

llama.cpp — Releases TIER_1 (SO) · github-actions[bot] · 2026-07-16 14:04

b10043

<details open=""> CUDA: Support CUDA Virtual Devices (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/25228">#25228</a>) <ul> <li> support cuda virtual devices </li> <li> disable NCCL path when virtual devices are used </l…

llama.cpp — Releases TIER_1 (SO) · github-actions[bot] · 2026-07-16 11:24

b10042

<details open=""> Enable CUDA graphs on volta+turing (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/25749">#25749</a>) </details> Website: <ul> <li><a href="https://llama.app" rel="nofollow">https://llama.app</…

llama.cpp — Releases TIER_1 (SO) · github-actions[bot] · 2026-07-16 10:38

b10041

<details open=""> server: Ignore empty / non-existing <code>Origin</code> headers (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/25756">#25756</a>) Otherwise this gives lots of unnecessary warnings: W srv operator(): (CORS) …

llama.cpp — Releases TIER_1 (SO) · github-actions[bot] · 2026-07-16 09:57

b10040

<details open=""> ggml-cuda : restore prop.integrated on HIP builds (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/24233">#24233</a>) PR <a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/16308">#1…

llama.cpp — Releases TIER_1 (SO) · github-actions[bot] · 2026-07-16 06:59

b10038

<details open=""> ci : add official website link to release notes (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/25728">#25728</a>) Assisted-by: pi:llama.cpp/Qwen3.6-27B </details> Website: <ul> <li><a h…

llama.cpp — Releases TIER_1 (SO) · github-actions[bot] · 2026-07-16 06:17

b10037

<details open=""> quant : allow using manual tensor types with --pure (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/25716">#25716</a>) </details> macOS/iOS: <ul> <li><a href="https://github.com/ggml-org/llama.…

llama.cpp — Releases TIER_1 (SO) · github-actions[bot] · 2026-07-16 05:32

b10036

<details open=""> opencl: disable FA and MoE weights repack to work around compiler issues for Adreno 850 GPU (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/25745">#25745</a>) <ul> <li> opencl: workaround for A850 compiler compat</…

llama.cpp — Releases TIER_1 (SO) · github-actions[bot] · 2026-07-16 05:00

b10035

<details open=""> cuda: extract Q1_0 elements via __byte_perm (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/25628">#25628</a>) </details> macOS/iOS: <ul> <li><a href="https://github.com/ggml-org/llama.cpp/rele…

llama.cpp — Releases TIER_1 (SO) · github-actions[bot] · 2026-07-15 20:37

b10034

<details open=""> opencl: exclude some moe kernels on Adreno a7x (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/25698">#25698</a>) <ul> <li>opencl: exclude Adreno A7x from using Adreno MoE kernels</li> </ul> Some compilers for A7x …

llama.cpp — Releases TIER_1 (SO) · github-actions[bot] · 2026-07-15 19:53

b10032

<details open=""> cuda : CUDA GGML_OP_LIGHTNING_INDEXER implementation (generic vector kernel + wmma kernel) (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/25545">#25545</a>) <ul> <li> cuda : CUDA GGML_OP_LIGHTNING_INDEXER implemen…

llama.cpp — Releases TIER_1 (SO) · github-actions[bot] · 2026-07-15 19:17

b10031

<details open=""> tokenize : drop --stdin mutual-exclusion check (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/25672">#25672</a>) match cli and completion, which don't enforce it </details> macOS/iOS: <…

llama.cpp — Releases TIER_1 (SO) · github-actions[bot] · 2026-07-15 16:12

b10025

<details open=""> cuda : relax tensor contiguity requirements for quantized concat (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/25678">#25678</a>) <ul> <li> cuda : relax tensor contiguity requirements for quantized concat </l…

llama.cpp — Releases TIER_1 (SO) · github-actions[bot] · 2026-07-15 14:22

b10021

<details open=""> DeepseekV4: reduce graph splits (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/25702">#25702</a>) </details> macOS/iOS: <ul> <li><a href="https://github.com/ggml-org/llama.cpp/releases/downloa…

llama.cpp — Releases TIER_1 (SO) · github-actions[bot] · 2026-07-15 13:39

b10020

<details open=""> sycl : fix get_rows Q2_K, Q4_K, Q5_K (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/25656">#25656</a>) </details> macOS/iOS: <ul> <li><a href="https://github.com/ggml-org/llama.cpp/releases/do…

llama.cpp — Releases TIER_1 (SO) · github-actions[bot] · 2026-07-15 13:03

b10019

<details open=""> sycl : support kernel type fp16 for conv2d_dw (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/25653">#25653</a>) </details> macOS/iOS: <ul> <li><a href="https://github.com/ggml-org/llama.cpp/re…

llama.cpp — Releases TIER_1 (SO) · github-actions[bot] · 2026-07-15 12:23

b10018

<details open=""> sycl : implement xielu op (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/25550">#25550</a>) </details> macOS/iOS: <ul> <li><a href="https://github.com/ggml-org/llama.cpp/releases/download/b100…

llama.cpp — Releases TIER_1 (SO) · github-actions[bot] · 2026-07-15 11:39

b10017

<details open=""> sycl: Increase minimum buffer size for USM system allocations (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/25525">#25525</a>) Raise the threshold for minimum buffer size from 1 GiB to 4 GiB, based on real-…

llama.cpp — Releases TIER_1 (SO) · github-actions[bot] · 2026-07-15 09:14

b10016

<details open=""> [SYCL] Flash Attention with XMX engine via oneDNN (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/25222">#25222</a>) <ul> <li> [SYCL] F16 (default) Flash Attention with XMX engine via oneDNN graph API; Qwen3.6-27b-…

llama.cpp — Releases TIER_1 (SO) · github-actions[bot] · 2026-07-15 03:26

b10015

<details open=""> opencl: do not use <code>clCreateBufferWithProperties</code> when targeting CL 2.x (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/25673">#25673</a>) </details> macOS/iOS: <ul> <li><a href="htt…

llama.cpp — Releases TIER_1 (SO) · github-actions[bot] · 2026-07-14 21:36

b10012

<details open=""> hexagon: fix hmx-queue signal enum-narrowing problem (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/25677">#25677</a>) </details> macOS/iOS: <ul> <li><a href="https://github.com/ggml-org/llama…

llama.cpp — Releases TIER_1 (SO) · github-actions[bot] · 2026-07-14 20:57

b10011

<details open=""> server : refactor prompt cache state ownership (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/25649">#25649</a>) <ul> <li> server : clear checkpoints upon prompt clear </li> <li> server : move the prompt st…

llama.cpp — Releases TIER_1 (SO) · github-actions[bot] · 2026-07-14 20:27

b10010

<details open=""> server: add --cors-* options (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/25655">#25655</a>) <ul> <li> server: add --cors-* options </li> <li> add special "localhost" value </li> <li> add tests…

llama.cpp — Releases TIER_1 (SO) · github-actions[bot] · 2026-07-14 19:44

b10007

<details open=""> opencl: fix a dp4a bug for devices where cl_khr_integer_dot_product is unavailable (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/25639">#25639</a>) <ul> <li> opencl: do not fail backend init on devices without cl…

llama.cpp — Releases TIER_1 (SO) · github-actions[bot] · 2026-07-14 18:59

b10005

<details open=""> DeepseekV4: fix seq_rm (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/25588">#25588</a>) <ul> <li> DeepseekV4: fix seq_rm </li> <li> implement proper seq_cp </li> <li> create actual update context</p…

llama.cpp — Releases TIER_1 (SO) · github-actions[bot] · 2026-07-14 18:18

b10004

<details open=""> vulkan/cpu: Support f16 as SET_ROWS src. (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/25432">#25432</a>) <ul> <li>vulkan/cpu: Support f16 as SET_ROWS src.</li> </ul> This adds full support for f16 SET_ROWS (equi…

llama.cpp — Releases TIER_1 (SO) · github-actions[bot] · 2026-07-14 17:44

b10003

<details open=""> tokenize : align usage by using common args (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/25516">#25516</a>) Migrate the tokenize tool to common_params_parse, replacing its hand-rolled argv parsing, Windows…

llama.cpp — Releases TIER_1 (SO) · github-actions[bot] · 2026-07-14 15:21

b10002

<details open=""> ggml : add a set of functions for checking contiguity of inner tensor dimensions (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/25650">#25650</a>) Co-authored-by: Stanisław Szymczyk <a href="mailto:sszymczy@gmail.…

llama.cpp — Releases TIER_1 (SO) · github-actions[bot] · 2026-07-14 12:47

b10001

<details open=""> tests: export-graph-ops: exit gracefully when called w/o arguments (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/25619">#25619</a>) Fixes a segfault when <code>test-export-graph-ops</code> is called without any<b…

llama.cpp — Releases TIER_1 (SO) · github-actions[bot] · 2026-07-14 12:07

b10000

<details open=""> ggml: uniformize im2col dst_type for all conv ops (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/23660">#23660</a>) <ul> <li> ggml: uniformize im2col dst_type for all conv ops </li> <li> Update ggml/src/ggm…

报道来源 [76]

相关实体

相关话题