PulseAugur
中
实时 00:27:37

llama.cpp 发布带来 OpenVINO 更新、Vulkan、GGUF 和 SYCL 改进

llama.cpp 项目发布了多个更新,包括 b11024 版本,该版本更新了 OpenVINO 2026.4 并修复了各种编译器警告。其他近期版本,如 b11022 和 b11020,分别改进了 Vulkan 支持和 DeepSeek 模型的消息分隔符解析。b11019 版本解决了 GGUF 文件对齐和 LoRA 加载问题,而 b11013 解决了 Vulkan 着色器中的缓冲区对齐问题。早期的更新,如 b11017 和 b11016,侧重于 Vulkan 和 SYCL 优化,b11015 包括了 OpenCL 警告的修复。 AI

影响 这些对 llama.cpp 的更新增强了其在各种硬件和软件配置下的性能和兼容性,可能提高本地运行大型语言模型的效率。

排序理由 该集群包含 llama.cpp 项目的多个发布说明,详细介绍了渐进式的软件更新和错误修复,而不是新产品发布或重大的研究突破。

在 llama.cpp — Releases 阅读 →

AI 生成摘要 · Google Gemini · 来自 57 个来源。 我们如何撰写摘要 →

llama.cpp 发布带来 OpenVINO 更新、Vulkan、GGUF 和 SYCL 改进

本文如何被排名

Signal score
0 / 100
Composite score across the factors below. Higher = stronger signal that this story matters right now.
Newsworthiness bucket
Tool
该集群包含 llama.cpp 项目的多个发布说明,详细介绍了渐进式的软件更新和错误修复,而不是新产品发布或重大的研究突破。
Source corroboration
57 independent sources
Strong cross-source corroboration — multiple independent publishers covered this within the clustering window.
Topics
product, infra
Editorial topic classification. Feeds into how the story surfaces on /topic/<slug> hub pages and into the per-entity coverage mix.
AI-industry relevance
High
Clearly on-topic for AI-industry coverage.
Story freshness
58 days old
Aged out of breaking-news scoring windows; ranking reflects the durable signal from the full source set.
Coverage growth since scoring
+37 source(s) since last score
New sources have picked up this story since our last re-score. Score will update on the next scoring pass.

完整方法见我们的编辑标准。

报道来源 [57]

  1. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b11081

    <details open=""> <p>test-llama-archs : make tensor data stdev configurable and improve help (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/29133">#29133</a>)</p> <ul> <li>test-llama-archs : make tensor data stdev configurable</li> </ul> <p>…

  2. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b11080

    <details open=""> <p>tests/test-backend-ops : allow regex entries in the -o filter (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/29204">#29204</a>)</p> <ul> <li>tests/test-backend-ops : allow regex entries in the -o filter</li> </ul> <p>so …

  3. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b11078

    <details open=""> <p>args: add env vars for temperature, top-p, min-p and penalties (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/27380">#27380</a>)</p> <p>Allow configuring --temp, --top-p, --min-p, --repeat-penalty,<br /> --presence-penal…

  4. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b11077

    <details open=""> <p>server : do not forward --api-key-file to router-spawned child instances (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28938">#28938</a>)</p> <p>In router mode, authentication belongs to the router. unset_reserved_args(…

  5. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b11076

    <details open=""> <p>tests : remove stale comment (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/29140">#29140</a>)</p> </details> <p><strong>Website:</strong></p> <ul> <li><a href="https://llama.app" rel="nofollow">https://llama.app</a></li…

  6. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b11075

    <details open=""> <p>ggml-metal : simplify fusion pattern op list declaration (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/29206">#29206</a>)</p> <ul> <li>ggml-metal : derive non-empty fusion ops from ops_all</li> </ul> <p>Assisted-by: pi:…

  7. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b11074

    <details open=""> <p>json: Fixed json enum handling (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28518">#28518</a>)</p> <ul> <li>Fixed json enum handling</li> </ul> <p>Added common_json_value handling for enum values.<br /> Added tests/tes…

  8. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b11073

    <details open=""> <p>sycl : coalesce MKL-FA softmax loads instead of one work-item per row (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28918">#28918</a>)</p> <ul> <li> <p>sycl : coalesce MKL-FA softmax loads instead of one work-item per r…

  9. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b11071

    <details open=""> <p>ci : Upgrade CUDA to 13.4 for Ubuntu CUDA Release Builds (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/29202">#29202</a>)</p> </details> <p><strong>Website:</strong></p> <ul> <li><a href="https://llama.app" rel="nofollo…

  10. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b11070

    <details open=""> <p>hexagon: overhaul of buffer and DMA handling to support 64bit mappings + improvements (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/29197">#29197</a>)</p> <ul> <li>hex-dma64: enable support extended buffer mappings and …

  11. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b11069

    <details open=""> <p>cuda : tune MMVQ to MMQ crossover for SM70 (Volta) (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28912">#28912</a>)</p> <ul> <li>tune MMVQ to MMQ crossover for SM70 (Volta)</li> </ul> <p>Signed-off-by: Yangyu Chen <a hr…

  12. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b11068

    <details open=""> <p>metal : fix deprecation warnings from macOS 27 SDK (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/29136">#29136</a>)</p> </details> <p><strong>Website:</strong></p> <ul> <li><a href="https://llama.app" rel="nofollow">htt…

  13. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b11067

    <details open=""> <p>webgpu : add fused gdn + cpy (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28976">#28976</a>)</p> </details> <p><strong>Website:</strong></p> <ul> <li><a href="https://llama.app" rel="nofollow">https://llama.app</a></li…

  14. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b11065

    <details open=""> <p>CUDA: tune FA for Gemma 4 on Ampere or newer (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/29152">#29152</a>)</p> </details> <p><strong>Website:</strong></p> <ul> <li><a href="https://llama.app" rel="nofollow">https://l…

  15. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b11064

    <details open=""> <p>metal : support arbitrary hc in dsv4_hc_pre (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/29169">#29169</a>)</p> <p>the dsv4_hc_pre kernels hardcoded hc = 4 via a constexpr used with<br /> simd_shuffle, so the op was re…

  16. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b11063

    <details open=""> <p>common/peg : handle invalid utf-8 sequences in the AST (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/29161">#29161</a>)</p> <ul> <li> <p>common/peg : handle invalid utf-8 sequences in the AST</p> </li> <li> <p>cont : re…

  17. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b11062

    <details open=""> <p>CUDA: enable sparse fa for qwen4 (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28770">#28770</a>)</p> </details> <p><strong>Website:</strong></p> <ul> <li><a href="https://llama.app" rel="nofollow">https://llama.app</a>…

  18. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b11060

    <details open=""> <p>fix(mamba) : make time-step projection input contiguous (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28832">#28832</a>)</p> <ul> <li>mamba : make time-step projection input contiguous</li> </ul> <p>Assisted-by: ChatGPT…

  19. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b11059

    <details open=""> <p>metal: add F16 input to the FWHT (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/29094">#29094</a>)</p> <ul> <li>metal: add F16 input to the FWHT</li> </ul> <p>The Metal FWHT kernel accepts F32 input only. This change mak…

  20. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b11057

    <details open=""> <p>chat : add dedicated Ling 3.0 (Bailing V3) parser (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28682">#28682</a>)</p> <ul> <li>chat: add dedicated Ling 3.0 (Bailing V3) parser</li> </ul> <p>Ling 3.0 Flash templates pre…

  21. llama.cpp — Releases TIER_1 (SO) · aldehir ·

    b11058

    <p>chat : fix gemma4 required tool grammar (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/29115">#29115</a>)</p>

  22. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b11056

    <details open=""> <p>hexagon: enable I32 GET_ROWS (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/29116">#29116</a>)</p> </details> <p><strong>Website:</strong></p> <ul> <li><a href="https://llama.app" rel="nofollow">https://llama.app</a></li…

  23. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b11055

    <details open=""> <p>hexagon: add support for GEGLU_QUICK (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/29114">#29114</a>)</p> </details> <p><strong>Website:</strong></p> <ul> <li><a href="https://llama.app" rel="nofollow">https://llama.app…

  24. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b11054

    <details open=""> <p>hexagon: enable support for TOP_K op (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/29113">#29113</a>)</p> <ul> <li> <p>hexagon: enable support for TOP_K op</p> </li> <li> <p>hex-topk: thread single-row TOP_K, raise VTCM…

  25. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b11040

    <details open=""> <p>ggml : check for allocation failures to prevent crashes (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28149">#28149</a>)</p> <ul> <li> <p>ggml : check for allocation failures to prevent crashes</p> </li> <li> <p>wording…

  26. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b11039

    <details open=""> <p>Model-Saver: Write the SWA pattern, 15 more architectures roundtrip (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/29042">#29042</a>)</p> <ul> <li>llama: read the SWA pattern as a period or a per-layer array</li> </ul> <…

  27. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b11037

    <details open=""> <p>ggml-webgpu: fix supports_op condition for GET_ROWS (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28978">#28978</a>)</p> <ul> <li> <p>fix get_rows vec4 handling</p> </li> <li> <p>Add src strides checking to vec4_aligned…

  28. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b11036

    <details open=""> <p>ggml : handle graph buffer reservation failure (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/26070">#26070</a>)</p> </details> <p><strong>Website:</strong></p> <ul> <li><a href="https://llama.app" rel="nofollow">https:/…

  29. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b11035

    <details open=""> <p>vulkan: add IQ3_S MMQ matmul kernels (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28822">#28822</a>)</p> <ul> <li> <p>vulkan: add IQ3_S MMQ matmul kernels</p> </li> <li> <p>Make block_a_to_shmem do 2-byte loads (110 by…

  30. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b11034

    <details open=""> <p>vocab : add ufakzeka pre-tokenizer (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/29033">#29033</a>)</p> <ul> <li> <p>vocab : add ufakzeka pre-tokenizer</p> </li> <li> <p>vocab : move ufakzeka to the models list and rege…

  31. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b11033

    <details open=""> <p>cmake : fix build when GGML_CPU=OFF and GGML_CUDA=ON (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/29026">#29026</a>)</p> <ul> <li> <p>fix: build fails when GGML_CPU=OFF and GGML_CUDA=ON</p> </li> <li> <p>fix: eol in ex…

  32. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b11030

    <details open=""> <p>ci : bump android-actions/setup-android to 4.0.4 (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/29065">#29065</a>)</p> </details> <p><strong>Website:</strong></p> <ul> <li><a href="https://llama.app" rel="nofollow">https…

  33. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b11029

    <details open=""> <p>vulkan: raise the hoisted row-id limit for mul_mat_id from 256 to 1024 experts (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28501">#28501</a>)</p> <ul> <li>vulkan: raise the hoisted row-id limit for mul_mat_id to 512 e…

  34. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b11028

    <details open=""> <p>ci : add missing evict-old-files (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/29041">#29041</a>)</p> </details> <p><strong>Website:</strong></p> <ul> <li><a href="https://llama.app" rel="nofollow">https://llama.app</a>…

  35. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b11027

    <details open=""> <p>rpc : skip ACCEL devices (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/29020">#29020</a>)</p> </details> <p><strong>Website:</strong></p> <ul> <li><a href="https://llama.app" rel="nofollow">https://llama.app</a></li> </…

  36. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b11026

    <details open=""> <p>model : skip gate_up_exps if TENSOR_SKIP is set (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/29014">#29014</a>)</p> <p>required for qwen35moe if MTP tensors are fused but not loaded</p> </details> <p><strong>Website:</…

  37. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b11025

    <details open=""> <p>model : extend Nemotron MTP support (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/29018">#29018</a>)</p> <ul> <li> <p>first fix</p> </li> <li> <p>removed unnecessary declarations</p> </li> </ul> </details> <p><strong>We…

  38. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b11024

    <details open=""> <p>openvino : Update OpenVINO to 2026.4;fix clangd,MSVC warnings; (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/29009">#29009</a>)</p> <ul> <li> <p>Update to openvino-2026.4</p> </li> <li> <p>Update OV docs</p> </li> <li> …

  39. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b11022

    <details open=""> <p>vulkan: split buffers and debug code into separate files, add shared headers (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28732">#28732</a>)</p> </details> <p><strong>Website:</strong></p> <ul> <li><a href="https://lla…

  40. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b11020

    <details open=""> <p>chat : add message delimiters to the DeepSeek V3.2/V4 parser (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/29008">#29008</a>)</p> <ul> <li>chat : add message delimiters to the DeepSeek V3.2/V4 parser</li> </ul> <p>Assis…

  41. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b11019

    <details open=""> <p>gguf : align the data section relative to the GGUF start, not the file (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28993">#28993</a>)</p> <ul> <li>gguf : align the data section relative to the GGUF start, not the file…

  42. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b11018

    <details open=""> <p>sycl : fix the B70 mem allocate error when &gt;19.3GB (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28953">#28953</a>)</p> </details> <p><strong>Website:</strong></p> <ul> <li><a href="https://llama.app" rel="nofollow">…

  43. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b11017

    <details open=""> <p>vulkan: skip unneeded MoE work in mul_mm coopmat1 path (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/25483">#25483</a>)</p> </details> <p><strong>Website:</strong></p> <ul> <li><a href="https://llama.app" rel="nofollow"…

  44. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b11016

    <details open=""> <p>sycl: ssm_conv: fuse the SiLU epilogue into the ssm_conv kernel (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28929">#28929</a>)</p> </details> <p><strong>Website:</strong></p> <ul> <li><a href="https://llama.app" rel="…

  45. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b11015

    <details open=""> <p>opencl: fix various warnings (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28984">#28984</a>)</p> <ul> <li> <p>opencl: fix warnings</p> </li> <li> <p>opencl: fix warnings for non adreno</p> </li> </ul> </details> <p><st…

  46. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b11013

    <details open=""> <p>vulkan: fix buffer_reference alignment in im2col shaders (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28996">#28996</a>)</p> <p>Both im2col.comp and im2col_3d.comp declare D_ptr without an explicit<br /> buffer_referen…

  47. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b11012

    <details open=""> <p>vulkan: support qwen4exp hc ops (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28988">#28988</a>)</p> <ul> <li> <p>vulkan: support qwen4exp hc ops</p> </li> <li> <p>fix stale comment [no-ci]</p> </li> </ul> </details> <p…

  48. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b11011

    <details open=""> <p>[SYCL] Fix function signature for <code>ggml_backend_sycl_split_buffer_type</code> (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28981">#28981</a>)</p> </details> <p><strong>Website:</strong></p> <ul> <li><a href="https…

  49. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b11010

    <details open=""> <p>vulkan: work around NV bug with argsort_large.comp (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28975">#28975</a>)</p> </details> <p><strong>Website:</strong></p> <ul> <li><a href="https://llama.app" rel="nofollow">htt…

  50. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b11009

    <details open=""> <p>TP: fix split state and granularity for fused QKV gemma4, qwen35 (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28965">#28965</a>)</p> <ul> <li>model: calculate split states for attn_qkv from n_head * n_embd_head_k</li> …

  51. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b11007

    <details open=""> <p>Enable CUDA graph for MTP draft (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28549">#28549</a>)</p> <ul> <li> <p>Improve CUDA graph usage for MTP</p> </li> <li> <p>Rename field</p> </li> <li> <p>Address review feedback…

  52. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b11006

    <details open=""> <p>hexagon: Support for K-Quants Q4_K and Q6_K (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28994">#28994</a>)</p> <p>implement q6k/q4k kernels</p> <p>Squashed from:<br /> feat: implement q6k kernel<br /> hex-q6k: improve…

  53. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b11005

    <details open=""> <p>hexagon: accept the zeroed rope probe in supports_op (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28995">#28995</a>)</p> <p>llama probes weight placement with a rope where all params are 0, so rejecting<br /> n_dims ==…

  54. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b11003

    <details open=""> <p>model : add support for HrmTextForCausalLM (DFM Mimir 1B) (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/27625">#27625</a>)</p> <ul> <li>model : add support for HrmTextForCausalLM (DFM Mimir 1B)</li> </ul> <p>HRM-Text ru…

  55. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b11002

    <details open=""> <p>CUDA/HIP: improve access patterns in im2col (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/28013">#28013</a>)</p> </details> <p><strong>Website:</strong></p> <ul> <li><a href="https://llama.app" rel="nofollow">https://ll…

  56. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b11001

    <details open=""> <p>spacemit : fix wrong transpose function for int16 data (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/25161">#25161</a>)</p> <p>The <code>sizeof(int16_t)</code> branch in <code>permute_transpose_impl</code> calls<br /> <…

  57. llama.cpp — Releases TIER_1 (SO) · github-actions[bot] ·

    b11000

    <details open=""> <p>rpc : invalidate cached compute graph when a referenced buffer is freed (<a class="issue-link js-issue-link" href="https://github.com/ggml-org/llama.cpp/pull/24292">#24292</a>)</p> <p>The server caches the most recent compute graph per device so that<br /> GR…