ENTITY
--n-cpu-moe
--n-cpu-moe
PulseAugur coverage of --n-cpu-moe — every cluster mentioning --n-cpu-moe across labs, papers, and developer communities, ranked by signal.
Total · 30d
2
2 over 90d
Releases · 30d
0
0 over 90d
Papers · 30d
0
0 over 90d
TIER MIX · 90D
TOPICS
RECENT · PAGE 1/1 · 2 TOTAL
-
llama.cpp adds --n-cpu-ffn option for faster dense models on low VRAM
A new pull request for the llama.cpp project introduces the `--n-cpu-ffn` option, designed to improve the performance of dense models for users with limited VRAM. This feature allows a specified number of FFN sublayers …
-
Reddit user proposes disk-based MoE offloading for larger models
A user on the r/LocalLLaMA subreddit is proposing new features for Mixture of Experts (MoE) models, specifically suggesting "--disk-moe" or "--n-disk-moe" options. These would allow for offloading model layers to disk o…