The article argues that the current focus on token counting for AI development costs is misguided, as it penalizes valuable workflows that require multiple AI interactions. Instead, it proposes measuring the cost per merged pull request, which reflects the actual output of AI-assisted development. To optimize costs, developers should match AI models to task complexity, using powerful frontier models only for planning and reasoning, while routing routine tasks like code generation to less expensive, self-hosted open-weight models. This approach, combined with owned AI capacity, can reduce costs and enhance control over sensitive code. AI
IMPACT Shifts focus from AI consumption metrics to AI output, potentially optimizing enterprise AI spending and encouraging more efficient model usage.
RANK_REASON Article discusses a strategic shift in measuring AI development value, moving from token counts to shipped code, and suggests operational changes for cost optimization.
Read on MIT Technology Review →
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →