Google DeepMind has released DiffusionGemma, a novel Mixture-of-Experts (MoE) model that utilizes a technique borrowed from image generation to iteratively refine blocks of tokens in parallel. This approach allows the 26 billion parameter model to activate only 4 billion parameters at a time, resulting in processing speeds exceeding 1,000 tokens per second on consumer hardware. DiffusionGemma's unique architecture and parallel processing capabilities contribute to more dynamic and creative output compared to traditional autoregressive models. AI
IMPACT Sets a new precedent for LLM inference speed and output creativity through parallel token refinement.
RANK_REASON Frontier-lab model release with system card. [lever_c_demoted from frontier_release: ic=1 ai=1.0]
Read on Mastodon — mastodon.social →
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →