PulseAugur
EN
LIVE 23:40:35

GLM-5.2 runs on MacBook Pro M5, achieving 2.8 tokens/sec

A user has successfully implemented GLM-5.2 on a MacBook Pro M5 with 48 GB of RAM, achieving inference speeds between 2 and 2.8 tokens per second. The user experimented with different configurations, including using Flash MOE and a pre-prompt, noting performance variations based on task complexity and machine load. This setup is part of an ongoing experiment to potentially integrate GLM-5.2 with other models like Qwen for specific coding tasks. AI

IMPACT Demonstrates the feasibility of running advanced LLMs on local consumer hardware, potentially lowering barriers to entry for AI experimentation.

RANK_REASON User successfully running a specific model on consumer hardware.

Read on r/LocalLLaMA →

AI-generated summary · Google Gemini · from 1 sources. How we write summaries →

GLM-5.2 runs on MacBook Pro M5, achieving 2.8 tokens/sec

COVERAGE [1]

  1. r/LocalLLaMA TIER_1 English(EN) · /u/gutard ·

    GLM 5.2 running on MacBook Pro M5 48 GB Ram at between 2 - 2.8t/s

    <table> <tr><td> <a href="https://www.reddit.com/r/LocalLLaMA/comments/1uvlhxl/glm_52_running_on_macbook_pro_m5_48_gb_ram_at/"> <img alt="GLM 5.2 running on MacBook Pro M5 48 GB Ram at between 2 - 2.8t/s" src="https://preview.redd.it/td1ow57rs1dh1.png?width=140&amp;height=140&amp…