PulseAugur
EN
LIVE 02:34:18

Kimi K3 language model compressed for local use, retaining 78.9% accuracy

By PulseAugur Editorial · [2 sources] ·

Unsloth has released a compressed version of the Kimi K3 language model, making it suitable for local execution. The model has been quantized to various bit levels, with the smallest 1-bit version reducing the model size from 1.56 TB to 594 GB. This highly compressed model retains approximately 78.9% of its original accuracy, offering a significant reduction in storage requirements while maintaining considerable performance. AI

IMPACT Enables running advanced language models on less powerful hardware, increasing accessibility.

RANK_REASON Release of a quantized, smaller version of an existing language model.

Read on r/LocalLLaMA →

AI-generated summary · Google Gemini · from 2 sources. How we write summaries →

Kimi K3 language model compressed for local use, retaining 78.9% accuracy

COVERAGE [2]

  1. Mastodon — fosstodon.org TIER_1 Deutsch(DE) · [email protected] ·

    RT @UnslothAI: Kimi K3 can now be run locally! ✨ The 1-bit model retains ~78.9% accuracy after we compressed it from 1.56TB to 594GB

    RT @UnslothAI: Kimi K3 kann nun lokal ausgeführt werden! ✨ Das 1-Bit-Modell behält ~78,9 % der Genauigkeit bei, nachdem wir es von 1,56 TB auf 594 GB verkleinert haben (-62 % Größe). Läuft auf einem Mac Studio + 128 GB RAM Gerät. Kimi K3 ist das stärkste Open-Source-Modell bis da…

  2. r/LocalLLaMA TIER_1 English(EN) · /u/BankApprehensive7612 ·

    Kimi K3 for local use (1.56TB → 594GB) compressed and released by Unsloth

    <table> <tr><td> <a href="https://www.reddit.com/r/LocalLLaMA/comments/1va6ot2/kimi_k3_for_local_use_156tb_594gb_compressed_and/"> <img alt="Kimi K3 for local use (1.56TB → 594GB) compressed and released by Unsloth" src="https://external-preview.redd.it/-Pi0PiNmpJmI17QD0uo-SnFZHO…

RELATED ENTITIES

RELATED TOPICS