OpenAI's new 12-hour prompt caching option for its Responses API comes with a doubled write cost compared to the default 30-minute cache. This longer cache only becomes cost-effective if a stable prompt prefix would otherwise expire and need to be rewritten twice. For models like GPT-6.2 Astra, the 12-hour write costs $20 per million tokens, compared to $10 for 30 minutes, making it a loss for frequently changing prompts or if the cache is not utilized effectively. AI
IMPACT This pricing structure may influence how developers utilize prompt caching, potentially leading to more strategic use of longer cache lifetimes for stable prompts to manage costs.
RANK_REASON Article discusses pricing and cost-effectiveness of a specific feature (prompt caching) for an existing product (OpenAI's Responses API), rather than a new release or fundamental capability.
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →