PulseAugur
EN
LIVE 16:45:20

GLM-5.2 model runs on consumer hardware with 25GB RAM · 2 sources tracked

By PulseAugur Editorial · [3 sources] ·

The GLM-5.2 model, a 744B-parameter Mixture of Experts (MoE) model, is reportedly runnable on consumer hardware. One user shared that it can operate on a machine with approximately 25 GB of RAM, while another detailed its performance on a MacBook Pro M5 with 48 GB of RAM, achieving speeds between 2 to 2.8 tokens per second. This development suggests increased accessibility for running large language models locally. AI

IMPACT Enables wider accessibility and experimentation with large language models on personal devices.

RANK_REASON User-reported performance and accessibility of a large language model on consumer hardware.

Read on r/LocalLLaMA →

AI-generated summary · Google Gemini · from 3 sources. How we write summaries →

GLM-5.2 model runs on consumer hardware with 25GB RAM · 2 sources tracked

COVERAGE [3]

  1. Mastodon — fosstodon.org TIER_1 English(EN) · [email protected] ·

    https:// github.com/JustVugg/colibri it is possible to run GLM-5.2 (744B-parameter MoE) on a consumer machine with ~25 GB of RAM # ai # optimization # developme

    https:// github.com/JustVugg/colibri it is possible to run GLM-5.2 (744B-parameter MoE) on a consumer machine with ~25 GB of RAM # ai # optimization # development

    LINKS github.com/…/colibri
  2. r/LocalLLaMA TIER_1 English(EN) · /u/gutard ·

    GLM 5.2 running on MacBook Pro M5 48 GB Ram at between 2 - 2.8t/s

    <table> <tr><td> <a href="https://www.reddit.com/r/LocalLLaMA/comments/1uvlhxl/glm_52_running_on_macbook_pro_m5_48_gb_ram_at/"> <img alt="GLM 5.2 running on MacBook Pro M5 48 GB Ram at between 2 - 2.8t/s" src="https://preview.redd.it/td1ow57rs1dh1.png?width=140&amp;height=140&amp…

  3. r/singularity TIER_2 English(EN) · /u/Lopsided_Dot_4557 ·

    Colibri Hands-on: Running GLM 5.2 (744B) Locally without GPU

    <table> <tr><td> <a href="https://www.reddit.com/r/singularity/comments/1uwkzw6/colibri_handson_running_glm_52_744b_locally/"> <img alt="Colibri Hands-on: Running GLM 5.2 (744B) Locally without GPU" src="https://external-preview.redd.it/Y0H_QLEtOIIHrOWWBGDmNqivzH9PMwW73Z1CxN49qSI…

RELATED ENTITIES

RELATED TOPICS