A new benchmark for agentic coding, Forge 2.0, has revealed that the Jev Router, developed by TypeSafe, achieved the top score. However, the router predominantly directed nearly all of its calls, 117 out of 118, to GPT-6.1 Sol, with only one call going to GPT-6 Astra. This raises questions about whether the Jev Router itself is the primary driver of performance or if it effectively leverages GPT-6.1 Sol's capabilities, especially since GPT-6.1 Sol's direct builds scored lower than the Jev Router's median score. AI
IMPACT Highlights the potential for routing models to optimize LLM usage and cost, while also questioning the true performance attribution.
RANK_REASON The item details a new benchmark and its results for agentic coding models. [lever_c_demoted from research: ic=1 ai=1.0]
- Atlassian Forge
- Claude Opus 5.5
- DeepSeek V4.1 Flash
- Forge 2.0
- Gemini 4 Argon
- GPT-6.1 Sol
- GPT-6 Astra
- Jev Router
- OpenRouter
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →