Anthropic's Claude model has introduced message threads, which offer a 35% reduction in the time it takes to receive the first token for requests between 500,000 and 1 million tokens. However, these threads come with a 5-minute expiry and do not affect the billing cost. The feature was launched on November 2nd. AI
IMPACT This update improves response times for large context window requests, potentially enhancing user experience and efficiency for complex tasks.
RANK_REASON Product feature update for an existing model.
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →