PulseAugur
EN
LIVE 10:33:58

Unsloth releases Kimi k3 model with multiple large-size versions

Unsloth has released a new model named Kimi k3, offering several versions with varying sizes. The models include Q1_0 at 466GB, TQ1_0 at 509GB, IQ1_M at 649GB, and TQ2_0 at 551GB. This release provides users with different options for local deployment. AI

IMPACT Provides new options for users running large language models locally.

RANK_REASON Release of a new model version by a non-frontier lab. [lever_c_demoted from research: ic=1 ai=1.0]

Read on r/LocalLLaMA →

AI-generated summary · Google Gemini · from 1 sources. How we write summaries →

Unsloth releases Kimi k3 model with multiple large-size versions

COVERAGE [1]

  1. r/LocalLLaMA TIER_1 English(EN) · /u/Hannibalj2ca ·

    New Unsloth KImi K3 drops! Q1_0 (466GB), TQ1_0(509GB), IQ1_M(649),TQ2_0(551GB)!!

    <!-- SC_OFF --><div class="md"><p>The smallest UD-Q1_0 is 466GB, TQ2_0 551GB. Well done team Unsloth!</p> <p><a href="https://huggingface.co/unsloth/Kimi-K3-GGUF">https://huggingface.co/unsloth/Kimi-K3-GGUF</a></p> </div><!-- SC_ON --> &#32; submitted by &#32; <a href="https://ww…