Gemma 4-E2B runs in-browser at 255 tok/s with WebGPU kernels

A demo and WebGPU kernels for Gemma 4-E2B have been released, enabling in-browser operation at approximately 255 tokens per second. The optimization was reportedly aided by Fable 5 before its shutdown. The release includes a demo and kernels available on Hugging Face, with the model itself also linked. AI

IMPACT Enables faster, in-browser execution of Gemma 4-E2B, potentially improving accessibility for local LLM users.

RANK_REASON Release of optimized kernels and a demo for an existing model, not a new model release.

Read on r/LocalLLaMA →

• Gemma 4-E2B
• WebGPU

• product
• infra

AI-generated summary · Google Gemini · from 1 sources. How we write summaries →