English(EN) Length Value Model: Scalable Value Pretraining for Token-Level Length Modeling

Apple 发布 LenVM，用于 LLM 中的细粒度令牌级长度建模

作者 PulseAugur 编辑部 · [1 个来源] · 2026-07-20 00:00

Apple 研究人员推出了一种新颖的自回归模型令牌级长度建模框架——长度值模型 (LenVM)。该方法将长度预测视为一个值估计问题，为每个令牌分配负奖励，以创建可扩展且无需注释的监督信号。实验表明，LenVM 在 LIFEBench 等基准测试中显著提高了长度匹配性能，并提高了 GSM8K 等任务的效率，从而实现了准确性和令牌预算之间的可控权衡。 AI

影响引入了一种控制 LLM 中生成长度和效率的新方法，可能影响推理成本和模型性能。

排序理由详细介绍 LLM 新建模技术的学术论文。[lever_c_demoted from research: ic=1 ai=1.0]

在 Apple Machine Learning Research 阅读 →

AI 生成摘要 · Google Gemini · 来自 1 个来源。我们如何撰写摘要 →

本文如何被排名

Signal score: 0 / 100; Composite score across the factors below. Higher = stronger signal that this story matters right now.
Newsworthiness bucket: Tool; 详细介绍 LLM 新建模技术的学术论文。[lever_c_demoted from research: ic=1 ai=1.0]
Source corroboration: Single-source cluster; Only one publisher covered this so far. Single-source stories can still rank when the publisher is high-authority, but they lack cross-source corroboration.
Topics: paper, model release; Editorial topic classification. Feeds into how the story surfaces on /topic/<slug> hub pages and into the per-entity coverage mix.
AI-industry relevance: High; Clearly on-topic for AI-industry coverage.
Story freshness: 80 days old; Aged out of breaking-news scoring windows; ranking reflects the durable signal from the full source set.

完整方法见我们的编辑标准。

报道来源 [1]

Apple Machine Learning Research TIER_1 English(EN) · 2026-07-20 00:00

Length Value Model：可扩展价值预训练用于 Token 级长度建模

Token serves as the fundamental unit of computation in modern autoregressive models, and generation length directly influences both inference cost and reasoning performance. Despite its importance, existing approaches lack fine-grained length modeling, operating primarily at the …

本文如何被排名

报道来源 [1]

Length Value Model：可扩展价值预训练用于 Token 级长度建模

相关实体

相关话题