OpenAI has introduced a new prompt caching feature designed to significantly reduce costs for agent-based LLM applications. This feature offers a 90% discount on cached input tokens, with improved hit rates and new diagnostic tools. GitHub reported a more than 50% reduction in new prompt processing tokens after implementing this feature. The pricing structure for this caching is comparable to Anthropic's Claude Opus 5.5, though OpenAI has not yet specified a cache write fee. AI
IMPACT Significantly reduces operational costs for AI agents and could influence pricing strategies across the LLM market.
RANK_REASON New product feature release from a frontier AI lab. [lever_c_demoted from frontier_release: ic=1 ai=1.0]
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →