Inception Labs has launched Mercury 3, a diffusion-based LLM that achieves 1,068 tokens per second on NVIDIA GPUs, significantly outperforming autoregressive models in speed. This new architecture allows for parallel refinement of tokens across the entire sequence, enabling faster processing for tasks like infilling, editing, and constrained generation. While vendor benchmarks claim parity with models like GPT-6 Luna and Claude Haiku 5.5 in quality, independent evaluations are pending, and the ecosystem for diffusion LLMs is still developing. AI
IMPACT Accelerates agent task completion by reducing model inference time, potentially enabling new real-time AI applications.
RANK_REASON Frontier-lab model release with system card and performance claims. [lever_c_demoted from frontier_release: ic=2 ai=1.0]
- Baseten
- Claude Haiku 5.5
- GPT-6 Luna
- Mercury 2
- Mercury 2.5
- Mercury III
- Nie et al.
- Nvidia Gpus
- OpenRouter
- Vercel AI Gateway
- Auckland University of Technology
- Inception Labs
- Nvidia
- .openai
- Vercel
AI-generated summary · Google Gemini · from 2 sources. How we write summaries →