Inception Labs has introduced Mercury 3, a new diffusion-based language model designed to address latency issues in AI agent workflows. Unlike traditional autoregressive models that generate text token by token, Mercury 3 uses a parallel refinement approach, enabling it to achieve significantly higher speeds. The model reports generating up to 1,068 tokens per second on NVIDIA GPUs and offers a 1 million token context window, making it suitable for real-time applications and agentic tasks where speed is critical. AI
IMPACT This model's focus on low latency and parallel generation could significantly speed up complex AI agent workflows.
RANK_REASON Frontier-lab model release with system card [lever_c_demoted from frontier_release: ic=1 ai=1.0]
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →