Gemma-4-31B model hits 463K tokens/sec on TPU v6e-4 benchmarks

A performance report details the Gemma-4-31B model's capabilities on Cloud TPU v6e-4 hardware, achieving a peak prefill throughput of 463,345 tokens/sec. The benchmarks indicate that the dense 31B model offers comparable throughput to a 26B MoE model on the same hardware, with better latency for interactive tasks. However, the MoE model demonstrates superior compute efficiency and can handle much larger context windows. AI

影响 Demonstrates hardware-software co-optimization for dense models, offering insights into performance trade-offs against MoE architectures.

排序理由 This is a performance report and benchmark analysis of a specific model on particular hardware, not a new model release or significant industry event. [lever_c_demoted from research: ic=1 ai=1.0]

在 dev.to — LLM tag 阅读 →

• Cloud TPU v6e-4
• Gemini CLI
• Gemma-4-31B
• Google
• Trillium
• vLLM

• 论文
• 基础设施

AI 生成摘要 · Google Gemini · 来自 1 个来源。 我们如何撰写摘要 →