Gemma 4 QAT MLX model size puzzles local LLM users

A user on the r/LocalLLaMA subreddit is inquiring about the unusually large file size of the MLX version of the Gemma 4 QAT model. They noted that this version is approximately 27GB, significantly larger than the non-QAT version (17GB) and the regular 4-bit MLX version (also 17GB). The user is seeking an explanation for this discrepancy in file size. AI

RANK_REASON User-generated question about a technical detail of a specific model version, lacking broader industry impact or official announcement.

Read on r/LocalLLaMA →

• Gemma 4 QAT
• MLX
• r/LocalLLaMA

• other

AI-generated summary · Google Gemini · from 1 sources. How we write summaries →