Anthropic has launched a public beta for "message threads" within its Messages API, a feature designed to reduce latency for long-context interactions. This new functionality allows users to send the full conversation history only once, with subsequent requests only including new messages and a response ID. Anthropic reports a median time-to-first-token reduction of approximately 35% for requests between 500,000 and 1 million tokens, though token usage and rates remain unchanged. The feature is already active by default for most Claude Code users and is available on platforms like Claude on AWS, Microsoft Foundry, and Google Cloud. AI
IMPACT Reduces latency for long-context AI applications, potentially improving agent performance and user experience.
RANK_REASON Product update for an API feature, not a core model release.
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →