A recent analysis comparing code generation models found that Claude Opus 5.5 required approximately 60% more output tokens per character of code compared to Gemini 4 Argon and GPT-6 Luna. This difference in token usage, particularly for output tokens which are more expensive on API calls, could significantly increase costs for users. The study tested these models across five programming languages using a consistent brick-breaker game task, with most generated games functioning correctly. AI
IMPACT Higher output token usage by Claude Opus 5.5 could lead to increased API costs for developers compared to Gemini and GPT-6.
RANK_REASON Analysis of model performance and token usage. [lever_c_demoted from research: ic=1 ai=1.0]
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →