Agentic 工作负载正在显著改变 AI 推理的经济性，大约一半的真实编码 Agent 请求超过 128,000 个 token。这一趋势正推动向专用推理硬件和分层定价模型转变，例如 Opus 和 Gemini Flash 等模型的“快速层”选项。token 使用量的增加并非归因于用户提示的延长，而是 Agent 本身生成和利用的广泛上下文。 AI
影响 Agentic AI 工作负载正在增加 token 使用量并推动对专用硬件的需求，可能导致 AI 服务新的定价结构。
排序理由 该集群包含关于 AI 推理经济和 Agentic 工作负载的分析和数据解释，而不是直接的产品发布或研究发现。
AI 生成摘要 · Google Gemini · 来自 3 个来源。 我们如何撰写摘要 →
Inference economics are shifting. Expect more "fast tier" pricing (Opus Fast, Gemini Flash), more specialized inference hardware (Cerebras, Groq), and more pressure on KV cache management. The next bottleneck isn't model intelligence. It's serving 100k+ context fast enough to
Even more striking: ~50% of requests already exceed 128k tokens. The driver isn't user prompts getting longer. It's everything the agent stuffs in before you even type: system prompts, tool definitions, skills, MCP schemas, prior turn context, file contents. Agentic workloads = h…
Agentic workloads are quietly rewriting inference economics. We pulled data from 432k real coding agent requests at SemiAnalysis and the median one isn't 32k, isn't 64k, but 96k input tokens. For context, that's more than the entire text of The Great Gatsby being shoved into the …