PulseAugur
EN
LIVE 15:27:21

Claude Code usage inflated by prompt caching, user finds

A user discovered that their reported usage of 1.36 billion tokens in Claude Code over a week was primarily due to prompt caching, with only about 36 million tokens representing new input or generated output. This high cache read ratio, accounting for 97.4% of the total, indicates efficient reuse of context for an agent-based system like Claude Code. While cost-effective, the user notes that high cache efficiency does not directly equate to improved inference quality or reasoning accuracy. AI

IMPACT Highlights the importance of understanding LLM token usage metrics, particularly for agentic systems, and the cost implications of prompt caching.

RANK_REASON User-provided analysis of a product's usage metrics, not a direct product release or research finding.

Read on dev.to — LLM tag →

AI-generated summary · Google Gemini · from 1 sources. How we write summaries →

Claude Code usage inflated by prompt caching, user finds

COVERAGE [1]

  1. dev.to — LLM tag TIER_1 English(EN) · flipslidersand ·

    I Thought I Used 1 Billion Tokens in Claude Code Last Week. Turns Out 97% Was Cache.

    <p>Last week, I pulled my Claude Code usage logs and saw this number:</p> <p>1.36 billion tokens in a single week.</p> <p>My first reaction was somewhere between impressed and alarmed.</p> <p>Then I looked at the breakdown.</p> <h2> The Breakdown </h2> <div class="table-wrapper-p…