PulseAugur
EN
LIVE 01:21:20

180B MoE model runs on gaming laptop via quantization and SSD streaming

By PulseAugur Editorial · [1 sources] ·

VIDRAFT has released POCKET-Darwin-180B-GGUF, a quantized version of their 180B parameter Mixture-of-Experts model designed to run on consumer hardware. This version, available in GGUF format, can operate on a gaming laptop with 8GB VRAM and 32GB RAM by utilizing sparse activation and SSD streaming via llama.cpp. The model reportedly maintains its accuracy after 4-bit quantization, with no measurable degradation on the MMLU-Pro benchmark according to VIDRAFT's self-reported tests. AI

IMPACT Enables deployment of large-scale models on consumer hardware, potentially broadening access for on-premise and air-gapped applications.

RANK_REASON Release of a quantized, consumer-deployable version of a large MoE model.

Read on dev.to — LLM tag →

AI-generated summary · Google Gemini · from 1 sources. How we write summaries →

180B MoE model runs on gaming laptop via quantization and SSD streaming

How we ranked this

Signal score
26 / 100
Composite score across the factors below. Higher = stronger signal that this story matters right now.
Newsworthiness bucket
Tool
Release of a quantized, consumer-deployable version of a large MoE model.
Source corroboration
Single-source cluster
Only one publisher covered this so far. Single-source stories can still rank when the publisher is high-authority, but they lack cross-source corroboration.
Topics
model release, infra
Editorial topic classification. Feeds into how the story surfaces on /topic/<slug> hub pages and into the per-entity coverage mix.
AI-industry relevance
High
Clearly on-topic for AI-industry coverage.
Story freshness
Breaking (< 6h)
Fresh story with cross-source coverage still developing. Ranking may shift as more sources report.

Full methodology in our editorial standards.

COVERAGE [1]

  1. dev.to — LLM tag TIER_1 English(EN) · AI OpenFree ·

    Running a 180B-Parameter MoE Model on a Gaming Laptop: VIDRAFT's POCKET-Darwin-180B-GGUF

    <h1> Running a 180B-Parameter MoE Model on a Gaming Laptop: VIDRAFT's POCKET-Darwin-180B-GGUF </h1> <blockquote> <p><strong>TL;DR:</strong> VIDRAFT has released POCKET-Darwin-180B-GGUF, a 4-bit quantized, GGUF-format version of their 180B Mixture-of-Experts model that runs on con…

RELATED ENTITIES

RELATED TOPICS