English(EN) Splitting the router from the worker cut p95 latency 47% — and tripled cache reads

DeepSeek 超级代理分离路由器和工作节点，降低延迟

作者 PulseAugur 编辑部 · [1 个来源] · 2026-11-03 15:08

DeepSeek 开发了一种原型“超级代理”架构，将请求路由与工作节点执行分离，从而带来了显著的性能提升。在模拟中，与单会话基线相比，这种分离架构将中位数延迟降低了约 47%，并改善了 p95 延迟。然而，这种架构改变也导致缓存读取量增加了两倍，表明在成本或资源利用方面可能存在权衡。 AI

影响这种架构转变可能导致更高效、响应更快的 AI 代理，并可能影响复杂 AI 任务的处理方式。

排序理由该条目描述了 AI 代理的原型架构和基准测试结果，属于研究范畴。[lever_c_demoted from research: ic=1 ai=1.0]

AI 生成摘要 · Google Gemini · 来自 1 个来源。我们如何撰写摘要 →

本文如何被排名

Signal score: 1 / 100; Composite score across the factors below. Higher = stronger signal that this story matters right now.
Newsworthiness bucket: Tool; 该条目描述了 AI 代理的原型架构和基准测试结果，属于研究范畴。[lever_c_demoted from research: ic=1 ai=1.0]
Source corroboration: Single-source cluster; Only one publisher covered this so far. Single-source stories can still rank when the publisher is high-authority, but they lack cross-source corroboration.
Topics: infra, product; Editorial topic classification. Feeds into how the story surfaces on /topic/<slug> hub pages and into the per-entity coverage mix.
AI-industry relevance: High; Clearly on-topic for AI-industry coverage.
Story freshness: Same-day; Cluster formed today. Ranking reflects the current source set at time of score.

完整方法见我们的编辑标准。

r/OpenAI TIER_2 English(EN) · /u/docdavkitty · 2026-11-03 15:08

将路由器与工作进程分离，p95 延迟降低 47% — 缓存读取量增加两倍

<table> <tr><td> <a href="https://www.reddit.com/r/OpenAI/comments/1xmvf87/splitting_the_router_from_the_worker_cut_p95/"> <img alt="Splitting the router from the worker cut p95 latency 47% — and tripled cache reads" src="https://external-preview.redd.it/ovEnqRuxLznF0Ovp7OMZqCl9X…