English(EN) M5 Max users: what models are you using & what tk/s are you getting?

M5 Max 用户讨论本地性能的最佳大语言模型

作者 PulseAugur 编辑部 · [1 个来源] · 2026-09-06 01:32

在 r/LocalLLaMA 子版块的用户正在讨论哪些大语言模型（LLMs）在 M5 Max 硬件上表现最佳。参与者们分享了他们使用不同模型和量化方法的经验，以优化性能和每秒生成的 token 数（tk/s）。对话突出了 Qwen 和 GLM 等模型的进展，用户将当前速度与旧的基准进行比较。 AI

影响用户正在分享关于优化本地大语言模型性能的见解，这可能会为使用类似硬件的其他人提供信息。

排序理由用户讨论现有模型在硬件上的性能表现。

AI 生成摘要 · Google Gemini · 来自 1 个来源。我们如何撰写摘要 →

本文如何被排名

Signal score: 1 / 100; Composite score across the factors below. Higher = stronger signal that this story matters right now.
Newsworthiness bucket: Commentary; 用户讨论现有模型在硬件上的性能表现。
Source corroboration: Single-source cluster; Only one publisher covered this so far. Single-source stories can still rank when the publisher is high-authority, but they lack cross-source corroboration.
Topics: product, infra; Editorial topic classification. Feeds into how the story surfaces on /topic/<slug> hub pages and into the per-entity coverage mix.
AI-industry relevance: High; Clearly on-topic for AI-industry coverage.
Story freshness: Breaking (< 6h); Fresh story with cross-source coverage still developing. Ranking may shift as more sources report.

完整方法见我们的编辑标准。

r/LocalLLaMA TIER_1 English(EN) · /u/A_Wild_Entei · 2026-09-06 01:32

M5 Max 用户：你们在使用什么型号？跑出了多少 tk/s？

<div class="md"><p>I was using antirez’s ds4 for a while and getting around 20 tk/s, which worked for my purposes. But I know there have been big advancements between Qwen, the DS4 vision model, and GLM.</p> <p>I’m not sure how the quants affect performance, so wha…