三篇新研究论文探索了大型语言模型的先进压缩技术。LRCC将条件计算引入低秩分解，动态分配每个token的计算量，以提高Llama和Qwen等模型的性能。NeuralZip专注于通过重用统计分析和代码构建来实现快速无损压缩，从而显著加快速度并实现精确重建。OrBIT提出了一个用于嵌入压缩的结构引导框架，学习可重用的局部几何形状，在GPT-2等模型上实现高压缩率，同时保持有竞争力的性能。 AI
影响 这些压缩技术可以显著降低部署和运行大型语言模型相关的计算和存储成本，使它们更易于访问和更高效。
排序理由 三篇在arXiv上发表的独立研究论文，详细介绍了压缩大型语言模型的新颖方法。
AI 生成摘要 · Google Gemini · 来自 3 个来源。 我们如何撰写摘要 →
完整方法见我们的编辑标准。
arXiv:2610.08858v1 Announce Type: new Abstract: Low-rank compression reduces the cost of pretrained language models by replacing linear transformations with low-rank factorizations. However, conventional methods use a fixed rank allocation during inference, assigning the same amo…
arXiv:2610.09916v1 Announce Type: new Abstract: Lossless compression can reduce the storage and movement of model weights without changing their floating-point values, but repeated statistical analysis and code construction add computational overhead. We study whether the statist…
arXiv:2610.10385v1 Announce Type: new Abstract: Embedding tables are among the largest components of modern language models. Most compression methods fix a coding geometry such as coordinate blocks, low-rank subspaces, or unrestricted codebooks, and optimize within it. We instead…