(CA) [Open PR] llama : add --n-cpu-ffn option by John-194 · Pull Request #26622 · ggml-org/llama.cpp

llama.cpp 为密集模型添加 CPU 卸载选项

作者 PulseAugur 编辑部 · [1 个来源] · 2026-08-19 11:40

llama.cpp 项目已提交一个新的拉取请求，提议添加 `--n-cpu-ffn` 选项。此功能旨在为密集模型提供 CPU 卸载功能，类似于现有的用于专家混合 (MOE) 模型的 `--n-cpu-moe` 选项。此拉取请求由 John-194 提交，预计将提高在本地硬件上运行密集模型的用户的性能和灵活性，特别是对于 VRAM 有限的用户。 AI

影响通过改进密集模型的 CPU 卸载，增强了本地 LLM 的部署。

排序理由开源项目中新功能的拉取请求。

在 r/LocalLLaMA 阅读 →

基础设施

AI 生成摘要 · Google Gemini · 来自 1 个来源。我们如何撰写摘要 →

本文如何被排名

Signal score: 0 / 100; Composite score across the factors below. Higher = stronger signal that this story matters right now.
Newsworthiness bucket: Tool; 开源项目中新功能的拉取请求。
Source corroboration: Single-source cluster; Only one publisher covered this so far. Single-source stories can still rank when the publisher is high-authority, but they lack cross-source corroboration.
Topics: infra; Editorial topic classification. Feeds into how the story surfaces on /topic/<slug> hub pages and into the per-entity coverage mix.
AI-industry relevance: High; Clearly on-topic for AI-industry coverage.
Story freshness: 54 days old; Aged out of breaking-news scoring windows; ranking reflects the durable signal from the full source set.

完整方法见我们的编辑标准。

报道来源 [1]

r/LocalLLaMA TIER_1 (CA) · /u/pmttyji · 2026-08-19 11:40

[Open PR] llama: add --n-cpu-ffn option by John-194 · Pull Request #26622 · ggml-org/llama.cpp

<table> <tr><td> <a href="https://www.reddit.com/r/LocalLLaMA/comments/1vsjz2n/open_pr_llama_add_ncpuffn_option_by_john194_pull/"> <img alt="[Open PR] llama : add --n-cpu-ffn option by John-194 · Pull Request #26622 · ggml-org/llama.cpp" src="https://external-preview.redd.it/HNrd…

本文如何被排名

报道来源 [1]

[Open PR] llama: add --n-cpu-ffn option by John-194 · Pull Request #26622 · ggml-org/llama.cpp

相关实体

相关话题