PulseAugur
EN
LIVE 10:41:43

Qwen3.8-27B model quantized for 12GB/16GB cards with MTP

By PulseAugur Editorial · [2 sources] ·

A user has developed and released quantized versions of the Qwen3.8-27B model, specifically tailored for efficient use on consumer hardware with limited VRAM. These versions, including UD-IQ4_XS and others, are optimized for Multi Token Prediction (MTP) and offer varying context lengths and performance trade-offs, detailed in comparative tables and speed benchmarks. The releases aim to make powerful language models more accessible on common GPU configurations, with a focus on balancing quality and speed for tasks like coding and general agentic use. AI

IMPACT Enables running advanced LLMs on lower-spec hardware, broadening accessibility for AI tasks.

RANK_REASON User-developed quantizations and optimizations of existing LLMs for consumer hardware.

Read on r/LocalLLaMA →

AI-generated summary · Google Gemini · from 2 sources. How we write summaries →

Qwen3.8-27B model quantized for 12GB/16GB cards with MTP

How we ranked this

Signal score
0 / 100
Composite score across the factors below. Higher = stronger signal that this story matters right now.
Newsworthiness bucket
Tool
User-developed quantizations and optimizations of existing LLMs for consumer hardware.
Source corroboration
2 independent sources
Multiple independent publishers reporting the same story raises confidence that it's real and newsworthy.
Topics
model release, product
Editorial topic classification. Feeds into how the story surfaces on /topic/<slug> hub pages and into the per-entity coverage mix.
AI-industry relevance
High
Clearly on-topic for AI-industry coverage.
Story freshness
2 days old
Coverage has settled into its steady-state source set.

Full methodology in our editorial standards.

COVERAGE [2]

  1. r/LocalLLaMA TIER_1 English(EN) · /u/ZestRocket ·

    Qwen3.8-27B UD-IQ4_XS Heretic + MTP on a 16 GB card with 55-68 tok/s (24gb and 12gb versions available too)

    <!-- SC_OFF --><div class="md"><p>I wanted the uncensored Qwen3.8-27B (llmfan46's Heretic build, MTP head preserved) on my RTX 4080 with MTP on (because I've been testing TONS of configs, and realized that would be the one) </p> <p>And none of the published quants were built for …

  2. r/LocalLLaMA TIER_1 English(EN) · /u/Brief-Tap-6616 ·

    Qwen3.8 27b with 200K ctx + MTP on 12GB Ampere Cards

    <table> <tr><td> <a href="https://www.reddit.com/r/LocalLLaMA/comments/1x1xt1x/qwen38_27b_with_200k_ctx_mtp_on_12gb_ampere_cards/"> <img alt="Qwen3.8 27b with 200K ctx + MTP on 12GB Ampere Cards" src="https://external-preview.redd.it/eDZvdXJoMXpnaXVoMTyt2cUBHuHfJUkiltSAUhBwGkjrDa…

RELATED ENTITIES

RELATED TOPICS