PulseAugur
EN
LIVE 22:54:50

Unsloth releases Kimi K3 GGUF models, including large MXFP4 version

By PulseAugur Editorial · [1 sources] ·

Unsloth has started releasing GGUF model files for Kimi K3. The initial releases include the MXFP4 model, which is 1.5 TB in size, and the mmproj component. These files are available for users to download and utilize. AI

IMPACT Enables local deployment of the Kimi K3 model for users with compatible hardware.

RANK_REASON Release of model files in a specific format (GGUF) by a third-party provider (Unsloth) for an existing model (Kimi K3).

Read on r/LocalLLaMA →

AI-generated summary · Google Gemini · from 1 sources. How we write summaries →

Unsloth releases Kimi K3 GGUF models, including large MXFP4 version

COVERAGE [1]

  1. r/LocalLLaMA TIER_1 English(EN) · /u/_TheWolfOfWalmart_ ·

    Unsloth has begun dropping Kimi K3 GGUFs. The MXFP4 (it's 1.5 TB) and mmproj are already there.

    <table> <tr><td> <a href="https://www.reddit.com/r/LocalLLaMA/comments/1v9c77r/unsloth_has_begun_dropping_kimi_k3_ggufs_the/"> <img alt="Unsloth has begun dropping Kimi K3 GGUFs. The MXFP4 (it's 1.5 TB) and mmproj are already there." src="https://external-preview.redd.it/-Pi0PiNm…

RELATED ENTITIES

RELATED TOPICS