English(EN) External Experience Serving in Production LLM Systems: A Deployment-Oriented Study of Quality-Cost Trade-offs

LLM研究发现选择性经验可改善质量-成本权衡

作者 PulseAugur 编辑部 · [3 个来源] · 2026-06-10 08:38

一篇新发表在arXiv上的研究探讨了在生产式LLM系统中纳入外部经验时的质量与成本权衡。研究表明，虽然外部经验可以提高任务质量，但也会增加延迟和服务压力。研究结果表明，选择性检索经验比无条件全局注入更有效，并且只有当质量提升的收益大于相关的在线成本时，才能实现外部经验的效益。 AI

影响这项研究为通过平衡性能提升与运营成本来优化LLM部署提供了见解。

排序理由该集群包含一篇详细介绍LLM系统研究结果的学术论文。

AI 生成摘要 · Google Gemini · 来自 3 个来源。我们如何撰写摘要 →

报道来源 [3]

arXiv cs.CL TIER_1 English(EN) · Lin Sun, Heming Zhang, Xiangzheng Zhang · 2026-06-11 04:00

External Experience Serving in Production LLM Systems: A Deployment-Oriented Study of Quality-Cost Trade-offs

arXiv:2606.11806v1 Announce Type: new Abstract: Production LLM systems accumulate reusable operational experience, but the practical deployment issue is not merely whether such experience can help. It is how different serving strategies trade off quality against online cost under…
arXiv cs.CL TIER_1 English(EN) · Xiangzheng Zhang · 2026-06-10 08:38

生产型LLM系统中外部经验的实践：面向部署的质量-成本权衡研究

Production LLM systems accumulate reusable operational experience, but the practical deployment issue is not merely whether such experience can help. It is how different serving strategies trade off quality against online cost under realistic constraints. Injecting external exper…
dev.to — LLM tag TIER_1 English(EN) · Gabriel Anhaia · 2026-06-13 10:58

The Cost-Quality-Latency Triangle: Instrumenting the LLM Trade-Off

<ul> <li> Book: <a href="https://www.amazon.de/-/en/dp/B0GXNNMKVF" rel="noopener noreferrer">Observability for LLM Applications</a> </li> <li> Also by me: Thinking in Go (2-book series) — <a href="https://xgabriel.com/go-book" rel="noope…