Unsloth releases Gemma 4 MTP GGUF weights for local use

Unsloth has released new MTP GGUF weights for the Gemma 4 model, offering versions in Q8, F16, and BF16 formats. These weights are available for the 31B, 26B-A4B, and 12B parameter sizes. The release provides enhanced options for users running Gemma 4 locally. AI

IMPACT Provides new options for running Gemma 4 locally with optimized weights.

RANK_REASON Release of model weights in a specific format (GGUF) for local LLM use. [lever_c_demoted from research: ic=1 ai=1.0]

Read on r/LocalLLaMA →

• Gemma 4
• MTP GGUF
• Unsloth

• model release
• product

AI-generated summary · Google Gemini · from 1 sources. How we write summaries →