English(EN) GAMMA: Global Bit Allocation for Mixed-Precision Models under Arbitrary Budgets

新的GAMMA框架优化LLM混合精度量化

作者 PulseAugur 编辑部 · [1 个来源] · 2026-08-28 04:00

研究人员开发了GAMMA，一个用于优化大型语言模型混合精度量化 novel framework。这个训练后流水线有效地为敏感模型模块分配比特，改善了精度-预算的权衡。GAMMA在Llama和Qwen模型上的表现优于现有方法，在保持高质量的同时实现了显著的内存占用减少。 AI

影响能够以显著减小的内存占用部署LLM，可能加速在资源受限设备上的采用。

排序理由该集群包含一篇详细介绍LLM量化新方法的学术论文。[lever_c_demoted from research: ic=1 ai=1.0]

AI 生成摘要 · Google Gemini · 来自 1 个来源。我们如何撰写摘要 →

本文如何被排名

Signal score: 26 / 100; Composite score across the factors below. Higher = stronger signal that this story matters right now.
Newsworthiness bucket: Tool; 该集群包含一篇详细介绍LLM量化新方法的学术论文。[lever_c_demoted from research: ic=1 ai=1.0]
Source corroboration: Single-source cluster; Only one publisher covered this so far. Single-source stories can still rank when the publisher is high-authority, but they lack cross-source corroboration.
Topics: paper, model release; Editorial topic classification. Feeds into how the story surfaces on /topic/<slug> hub pages and into the per-entity coverage mix.
AI-industry relevance: High; Clearly on-topic for AI-industry coverage.
Story freshness: Breaking (< 6h); Fresh story with cross-source coverage still developing. Ranking may shift as more sources report.

完整方法见我们的编辑标准。

arXiv cs.AI TIER_1 English(EN) · Zhangyang Yao, Haiyan Zhao, Haoyu Wang, Xu Han · 2026-08-28 04:00

GAMMA: 全局比特分配用于任意预算下的混合精度模型

arXiv:2605.18475v2 Announce Type: replace-cross Abstract: Mixed-precision quantization improves the budget--accuracy trade-off for large language models (LLMs) by allocating more bits to sensitive modules. However, automating this allocation at LLM scale faces a unique combinatio…