PulseAugur
EN
LIVE 19:40:17

Unsloth trims Kimi K3 LLM to under 500GB, boosting performance

Unsloth has released several versions of the Kimi K3 large language model, significantly reducing their file sizes. One version, IQ2_XXS, was trimmed from 711GB to 478GB by removing multilingual capabilities and retaining only English. Initial testing suggests this pruned model may be more accurate for coding tasks, though further validation is needed under controlled conditions. Other released versions include Q1_0 at 466GB and TQ2_0 at 551GB. AI

IMPACT Optimized LLM versions may enable wider local deployment and potentially improve performance on specific tasks.

RANK_REASON This is a release of optimized versions of an existing LLM, not a novel frontier model release.

Read on r/LocalLLaMA →

AI-generated summary · Google Gemini · from 2 sources. How we write summaries →

Unsloth trims Kimi K3 LLM to under 500GB, boosting performance

How we ranked this

Signal score
0 / 100
Composite score across the factors below. Higher = stronger signal that this story matters right now.
Newsworthiness bucket
Tool
This is a release of optimized versions of an existing LLM, not a novel frontier model release.
Source corroboration
2 independent sources
Multiple independent publishers reporting the same story raises confidence that it's real and newsworthy.
Topics
model release, product
Editorial topic classification. Feeds into how the story surfaces on /topic/<slug> hub pages and into the per-entity coverage mix.
AI-industry relevance
High
Clearly on-topic for AI-industry coverage.
Story freshness
50 days old
Aged out of breaking-news scoring windows; ranking reflects the durable signal from the full source set.

Full methodology in our editorial standards.

COVERAGE [2]

  1. r/LocalLLaMA TIER_1 English(EN) · /u/Hannibalj2ca ·

    Kimi K3 (Unsloth) IQ2-XXS from 711GB down to 478GB!!! Only Multi-language was removed to trim the size

    <!-- SC_OFF --><div class="md"><p>Firstly a big thanks to the poster &quot;hellohazine&quot;, he basically only removed the multi-lingual fat of the model and just kept the English language intact. It is the exact model, and the rest of the model still intact with all of its high…

  2. r/LocalLLaMA TIER_1 English(EN) · /u/Hannibalj2ca ·

    New Unsloth KImi K3 drops! Q1_0 (466GB), TQ1_0(509GB), IQ1_M(649),TQ2_0(551GB)!!

    <!-- SC_OFF --><div class="md"><p>The smallest UD-Q1_0 is 466GB, TQ2_0 551GB. Well done team Unsloth!</p> <p><a href="https://huggingface.co/unsloth/Kimi-K3-GGUF">https://huggingface.co/unsloth/Kimi-K3-GGUF</a></p> </div><!-- SC_ON --> &#32; submitted by &#32; <a href="https://ww…