Google has introduced Gemma 4, a new family of open-weight, multimodal language models. The Gemma 4 suite includes models with parameter counts ranging from 2.3B to 31B, featuring both dense and Mixture-of-Experts architectures. These models incorporate enhanced vision and audio encoders, and a novel encoder-free architecture for the 12B model that processes raw audio and image patches. Gemma 4 also introduces a 'thinking mode' for generating reasoning traces and offers improved inference speed, memory efficiency, and long-context capabilities, setting a new performance standard across STEM, multimodal, and long-context benchmarks. AI
IMPACT Establishes a new benchmark for open-weight multimodal models, potentially accelerating research and development in AI.
RANK_REASON The item is a technical report detailing a new model release from Google. [lever_c_demoted from research: ic=1 ai=1.0]
- alphaXiv
- arXiv
- CatalyzeX
- Connected Papers
- CORE Recommender
- DagsHub
- Gemma
- Gemma 4
- Gotit.pub
- Hugging Face
- Litmaps
- ScienceCast
- scite Smart Citations
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →