Google has released Gemma 2, an updated family of open large language models available in 9B and 27B parameter sizes. These models incorporate significant architectural changes, including a hybrid attention mechanism and Grouped-Query Attention (GQA), aimed at improving inference efficiency and reducing computational costs. Gemma 2 models are designed to run effectively on hardware like a single NVIDIA H100 GPU or Google TPU, making them more accessible for developers and researchers to fine-tune and deploy. AI
IMPACT Enhances efficiency for open LLMs, making them more competitive with larger proprietary models and lowering deployment costs.
RANK_REASON Frontier-lab model release with system card. [lever_c_demoted from frontier_release: ic=1 ai=1.0]
- Gemini
- Gemma
- Gemma 2
- Google AI Studio
- Hugging Face
- Hugging Face Transformers
- Kaggle
- NVIDIA H100
- PyTorch
- Tensorflow
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →