English(EN) M6 Mac Mini owners (32GB): now you can run Qwen3.8-27B in high quality on the Apple Neural Engine

Qwen3.8-27B 模型现已在配备 32GB RAM 的 M6 Mac mini 上运行

作者 PulseAugur 编辑部 · [1 个来源] · 2026-10-24 21:05

ANEMLL Forge 0.2.1 软件更新使拥有 32GB RAM 的 M6 Mac mini 用户能够运行 Qwen3.8-27B 大型语言模型。此次更新引入了 K/V 缓存的 INT8 量化，在保持速度的同时将内存使用量减少了 0.86 GB。性能基准测试显示，根据内容类型的不同，令牌生成速度各不相同，并针对长达 192K 令牌的更长上下文进行了优化预填充批次。 AI

影响允许拥有特定 Apple 硬件的用户在本地运行大型语言模型，提高了 AI 实验的可访问性。

排序理由使特定模型能够在消费级硬件上运行的软件更新。

在 r/LocalLLaMA 阅读 →

AI 生成摘要 · Google Gemini · 来自 1 个来源。我们如何撰写摘要 →

Qwen3.8-27B 模型现已在配备 32GB RAM 的 M6 Mac mini 上运行

本文如何被排名

Signal score: 13 / 100; Composite score across the factors below. Higher = stronger signal that this story matters right now.
Newsworthiness bucket: Tool; 使特定模型能够在消费级硬件上运行的软件更新。
Source corroboration: Single-source cluster; Only one publisher covered this so far. Single-source stories can still rank when the publisher is high-authority, but they lack cross-source corroboration.
Topics: model release, infra; Editorial topic classification. Feeds into how the story surfaces on /topic/<slug> hub pages and into the per-entity coverage mix.
AI-industry relevance: High; Clearly on-topic for AI-industry coverage.
Story freshness: Breaking (< 6h); Fresh story with cross-source coverage still developing. Ranking may shift as more sources report.

完整方法见我们的编辑标准。

报道来源 [1]

r/LocalLLaMA TIER_1 English(EN) · /u/Competitive-Bake4602 · 2026-10-24 21:05

M6 Mac Mini owners (32GB): now you can run Qwen3.8-27B in high quality on the Apple Neural Engine

<div class="md">ANEMLL Forge 0.2.1: Qwen3.8-27B on the M6 Neural Engine now runs up to 192K context (M6 32GB). New: INT8 K/V cache (half of FP16) and a smaller drafter sharing the target's output head — 0.86 GB less ANE memory, same speed. Decode d…

本文如何被排名

报道来源 [1]

M6 Mac Mini owners (32GB): now you can run Qwen3.8-27B in high quality on the Apple Neural Engine

相关实体

相关话题