Qwen3.5-9B outperforms Gemma-4-12B-it on benchmarks

A comparison of the Gemma-4-12B-it and Qwen3.5-9B large language models indicates that Qwen generally outperforms Gemma on a per-gigabyte basis. The Qwen model achieved better results in 5 out of 8 benchmarks, despite having a smaller parameter footprint. While Gemma-4-12B-it may show slightly superior coding capabilities, specialized fine-tunes of Qwen are available for such tasks. AI

IMPACT Qwen3.5-9B demonstrates competitive performance against larger models, potentially influencing choices for efficient local deployments.

RANK_REASON Comparison of two open-source models on benchmarks. [lever_c_demoted from research: ic=1 ai=1.0]

Read on r/LocalLLaMA →

• ChatGPT
• Gemma-4-12B-it
• Hugging Face
• Qwen3.5-9B

• model release
• paper

AI-generated summary · Google Gemini · from 1 sources. How we write summaries →