English(EN) Advancing SVD-based LLM Compression via Layer-Wise Error Model Search

新的LEMS和KFAC-SVD技术提高了大模型压缩的准确性

作者 PulseAugur 编辑部 · [1 个来源] · 2026-10-26 04:00

研究人员开发了一种名为逐层误差模型搜索（LEMS）的新方法，利用奇异值分解（SVD）来改进大型语言模型（LLMs）的压缩。LEMS通过引入逐层误差代理来解决现有方法的局限性，该代理能更好地捕捉误差传播和重要性，从而实现更有效的全局秩分配。此外，还提出了KFAC-SVD，通过使用令牌级统计信息来提高分解质量，有助于缓解秩亏损。这些技术在Mistral、Qwen3和Llama 3等模型上展示了高达4.8个百分点的显著准确性提升，并将困惑度平均降低了15%。 AI

影响这些压缩技术可能带来更高效的大型语言模型的部署和可访问性。

排序理由该集群包含一篇详细介绍大模型压缩新方法的学术论文。[lever_c_demoted from research: ic=1 ai=1.0]

在 arXiv cs.AI 阅读 →

AI 生成摘要 · Google Gemini · 来自 1 个来源。我们如何撰写摘要 →

本文如何被排名

Signal score: 18 / 100; Composite score across the factors below. Higher = stronger signal that this story matters right now.
Newsworthiness bucket: Tool; 该集群包含一篇详细介绍大模型压缩新方法的学术论文。[lever_c_demoted from research: ic=1 ai=1.0]
Source corroboration: Single-source cluster; Only one publisher covered this so far. Single-source stories can still rank when the publisher is high-authority, but they lack cross-source corroboration.
Topics: paper, infra; Editorial topic classification. Feeds into how the story surfaces on /topic/<slug> hub pages and into the per-entity coverage mix.
AI-industry relevance: High; Clearly on-topic for AI-industry coverage.
Story freshness: Breaking (< 6h); Fresh story with cross-source coverage still developing. Ranking may shift as more sources report.

完整方法见我们的编辑标准。

报道来源 [1]

arXiv cs.AI TIER_1 English(EN) · Moritz Thoma, Maximilian Groezinger, Maximilian Forstenh\"ausler, Emad Aghajanzadeh, Manoj Rohit Vemparala, Christos Anagnostopoulos, Pierpaolo Mori, Nael Fasfous, Alexander Frickenstein, Daniel Mueller-Gritschneder, Ulf Schlichtmann · 2026-10-26 04:00

通过逐层误差模型搜索推进基于SVD的大型语言模型压缩

arXiv:2610.32878v1 Announce Type: new Abstract: Low-rank SVD-based compression offers a powerful strategy to reduce the computational costs of LLMs. However, existing methods face two key limitations: (i) global rank allocation, where uncalibrated error proxies fail to capture co…

本文如何被排名

报道来源 [1]

通过逐层误差模型搜索推进基于SVD的大型语言模型压缩

相关实体

相关话题