(AF) Could we have a --disk-moe or --n-disk-moe like --cpu-moe or --n-cpu-moe so we can use disk/cpu/gpu ?

Reddit user proposes disk-based MoE offloading for larger models

By PulseAugur Editorial · [1 sources] · 2026-08-05 21:58

A user on the r/LocalLLaMA subreddit is proposing new features for Mixture of Experts (MoE) models, specifically suggesting "--disk-moe" or "--n-disk-moe" options. These would allow for offloading model layers to disk or central processing units (CPUs) in addition to graphics processing units (GPUs), enabling larger models to run on less powerful hardware. AI

IMPACT Enables running larger models on consumer hardware by leveraging disk storage for offloading.

RANK_REASON User proposal on a subreddit about local LLM deployment.

Read on r/LocalLLaMA →

infra

AI-generated summary · Google Gemini · from 1 sources. How we write summaries →

Reddit user proposes disk-based MoE offloading for larger models

COVERAGE [1]

r/LocalLLaMA TIER_1 (AF) · /u/storm1er · 2026-08-05 21:58

Could we have a --disk-moe or --n-disk-moe like --cpu-moe or --n-cpu-moe so we can use disk/cpu/gpu?

<div class="md"><p>Explicit title, It would be nice to have the ability to have 3 tiers moe offload :( </p> </div>   submitted by   <a href="https://www.reddit.com/user/storm1er"> /u/storm1er </a> <br /> <span><a href="https://www.reddit.com/r…

COVERAGE [1]

Could we have a --disk-moe or --n-disk-moe like --cpu-moe or --n-cpu-moe so we can use disk/cpu/gpu?

RELATED ENTITIES

RELATED TOPICS