PulseAugur
EN
LIVE 12:56:38

User questions DeepSeek-V4 Flash quantization format

A user on the r/LocalLLaMA subreddit is questioning the quantization format of the DeepSeek-V4 Flash model. The user points out that a Hugging Face repository by K. E. Bartowski lists the model as MXFP4, but the original model's page on Hugging Face does not show this quantization format, listing only BF16, I64, F32, F8_E8M0, F8_E4M3, and I8 tensors. The user is seeking clarification on this discrepancy. AI

RANK_REASON This is a user-generated question about a specific technical detail of a model, not an official release or announcement.

Read on r/LocalLLaMA →

AI-generated summary · Google Gemini · from 1 sources. How we write summaries →

User questions DeepSeek-V4 Flash quantization format

COVERAGE [1]

  1. r/LocalLLaMA TIER_1 English(EN) · /u/alex20_202020 ·

    Any idea why bartowski claims DeepSeek-V4-Flash is MXFP4?

    <!-- SC_OFF --><div class="md"><p><a href="https://huggingface.co/bartowski/DeepSeek-V4-Flash-GGUF">https://huggingface.co/bartowski/DeepSeek-V4-Flash-GGUF</a></p> <blockquote> <p>This model is in MXFP4 and as such has only been provided in MXFP4 format!</p> <p>Original model: <a…