English(EN) Context Is Not Free: Carbon-Aware LLM Routing for Multi-Turn LLM Web Services across Geo-Distributed Data Centers

新的CarbonRouter框架大幅削减大语言模型网络服务的排放

作者 PulseAugur 编辑部 · [1 个来源] · 2026-10-27 04:00

研究人员开发了CarbonRouter，一个旨在最大限度地减少与大语言模型（LLM）网络服务相关的碳排放的新框架。与以往将每次查询独立处理的方法不同，CarbonRouter考虑了多轮对话重新计算键值缓存的碳成本。通过联合选择每次查询的模型、GPU类型和地理区域，CarbonRouter旨在优化可持续性。实验表明，与现有的最先进路由器相比，它可以将二氧化碳排放量减少16%以上，并且对话越长，节省的越多。 AI

影响可能显著减少大规模大语言模型部署对环境的影响。

排序理由详细介绍大语言模型路由新框架的研究论文。[lever_c_demoted from research: ic=1 ai=1.0]

在 arXiv cs.AI 阅读 →

AI 生成摘要 · Google Gemini · 来自 1 个来源。我们如何撰写摘要 →

本文如何被排名

Signal score: 12 / 100; Composite score across the factors below. Higher = stronger signal that this story matters right now.
Newsworthiness bucket: Tool; 详细介绍大语言模型路由新框架的研究论文。[lever_c_demoted from research: ic=1 ai=1.0]
Source corroboration: Single-source cluster; Only one publisher covered this so far. Single-source stories can still rank when the publisher is high-authority, but they lack cross-source corroboration.
Topics: infra, paper; Editorial topic classification. Feeds into how the story surfaces on /topic/<slug> hub pages and into the per-entity coverage mix.
AI-industry relevance: High; Clearly on-topic for AI-industry coverage.
Story freshness: Same-day; Cluster formed today. Ranking reflects the current source set at time of score.

完整方法见我们的编辑标准。

报道来源 [1]

arXiv cs.AI TIER_1 English(EN) · Xiaoyang Zhang, Yuejun Yan, Qingang Zhang, Yonggang Wen · 2026-10-27 04:00

上下文并非免费：面向跨地理分布式数据中心的、支持碳感知的多轮 LLM Web 服务的路由

arXiv:2610.35230v1 Announce Type: cross Abstract: The sustainability of the Web has drawn growing attention, as large language model (LLM)-based web services leave a substantial carbon footprint. These services typically run in geo-distributed data centers whose grid carbon inten…

本文如何被排名

报道来源 [1]

上下文并非免费：面向跨地理分布式数据中心的、支持碳感知的多轮 LLM Web 服务的路由

相关实体

相关话题