PulseAugur
中
实时 02:32:55
English(EN) Learning When to Attend: Conditional Memory Access for Long-Context LLMs

新研究探讨 LLM 效率，从移动推理到训练稳定性

作者 PulseAugur 编辑部 · [10 个来源] ·

研究人员正在探索各种方法来提高大型语言模型 (LLM) 的效率和性能。一种名为“Thinking Seeds”的方法使用历史检查点来提高 LLM 中强化学习的稳定性和探索性。另一个重点是优化移动设备上的 LLM 推理，研究人员分析了神经处理单元 (NPU)、中央处理单元 (CPU) 和图形处理单元 (GPU) 中的瓶颈，以降低能耗。此外，还在开发“Full-Stack FP4”等技术，以使用 4 位精度实现稳定的 LLM 预训练，而“Memorization-Guided Data Reuse”旨在通过智能重用训练数据来提高样本效率。对于长上下文 LLM，一种称为 L2A (Learning To Attend) 的方法通过条件访问内存来扩展上下文长度，同时降低计算成本，而一个名为 DeadPool 的系统则通过零开销检查点和从节点故障中快速恢复来提供弹性的 LLM 训练。 AI

影响 这些进展旨在使 LLM 在各种硬件和训练场景中更高效、更易于访问、更具鲁棒性。

排序理由 该集群包含多篇关于 LLM 训练和推理技术的论文。

在 arXiv cs.CL 阅读 →

AI 生成摘要 · Google Gemini · 来自 10 个来源。 我们如何撰写摘要 →

新研究探讨 LLM 效率，从移动推理到训练稳定性

报道来源 [10]

  1. arXiv cs.CL TIER_1 English(EN) · Lei Yang, Wei Bi, Chenxi Sun, Renren Jin, Deyi Xiong ·

    思维种子：利用历史多样性实现LLM中的位置感知RL

    arXiv:2601.21476v2 Announce Type: replace Abstract: On-policy reinforcement learning (RL) for language model post-training suffers from a fundamental tension: as training progresses, policy entropy collapses and sampling diversity diminishes, causing the model to ``forget'' its o…

  2. arXiv cs.AI TIER_1 English(EN) · Guanyu Cai, Ruiming Tian, Lang Yang, Zhouhong Ren, Jinliang Yuan, Lingkun Li, Jiliang Wang ·

    您的NPU准备好迎接LLM了吗？剖析移动端LLM推理中隐藏的效率瓶颈

    arXiv:2607.05475v1 Announce Type: cross Abstract: Deploying Large Language Models (LLMs) on mobile devices enhances privacy and reduces latency, but is severely bottlenecked by hardware inefficiency. We present the first comprehensive, cross-layer measurement study of mobile LLM …

  3. arXiv cs.AI TIER_1 English(EN) · Siyu Ding, Mingchuan Ma, Jiabo Tong, Xingrun Xing, Ziming Wang, Guoqi Li ·

    Full-Stack FP4: 使用量化投影、优化器和注意力进行稳定的 LLM 预训练

    arXiv:2607.04422v1 Announce Type: cross Abstract: Recent NVFP4 pretraining methods mainly target transformer linear layers, leaving optimizer states, optimizer arithmetic and attention underexplored in 4-bit pipelines. This critical gap blocks stable full-stack 4-bit pretraining,…

  4. arXiv cs.CL TIER_1 English(EN) · Jingwei Zuo, Cong Zeng, Ilyas Chahed, Maksim Velikanov, Dhia Eddine Rhaiem, Pasquale Balsebre, Abhay Kumar, Younes Belkada, Hakim Hacid ·

    更聪明地训练，而非更久地训练：记忆引导的数据重用以实现高效 LLM 训练

    arXiv:2607.04969v1 Announce Type: cross Abstract: The training paradigm of large language models has shifted from traditional one-pass training to multi-epoch training, as reasonable reuse of limited high-quality data can improve both model performance and sample efficiency. Mean…

  5. arXiv cs.CL TIER_1 English(EN) · Sakshi Choudhary, Aditya Chattopadhyay, Luca Zancato, Elvis Nunez, Matthew Trager, Wei Xia, Stefano Soatto ·

    学习何时关注：长上下文LLM的条件记忆访问

    arXiv:2603.17484v2 Announce Type: replace Abstract: Language models struggle to generalize beyond pretraining context lengths, limiting long-horizon reasoning and retrieval. Continued pretraining on long-context data can help but is expensive due to the quadratic scaling of Atten…

  6. arXiv cs.CL TIER_1 English(EN) · Hakim Hacid ·

    更聪明地训练，而非更久地训练：基于记忆引导的数据重用以实现高效 LLM 训练

    The training paradigm of large language models has shifted from traditional one-pass training to multi-epoch training, as reasonable reuse of limited high-quality data can improve both model performance and sample efficiency. Meanwhile, excessive repetition introduces the risk of…

  7. Hugging Face Daily Papers TIER_1 English(EN) ·

    DeadPool：通过零开销检查点实现热插拔的弹性 LLM 训练

    State-of-the-art large language model (LLM) training takes tens of thousands of graphics processing units (GPUs) for months and encounters failures across the software and hardware stack. Existing fault-tolerance mechanisms either impose non-trivial overhead during failure-free e…

  8. Medium — fine-tuning tag TIER_1 English(EN) · Akshat Sharma ·

    微调大型语言模型的隐藏危险：灾难性遗忘（及其预防方法）

    <div class="medium-feed-item"><p class="medium-feed-image"><a href="https://medium.com/@sharmaakshat0707/the-hidden-danger-of-fine-tuning-llms-catastrophic-forgetting-and-how-to-prevent-it-e09b4a346123?source=rss------fine_tuning-5"><img src="https://cdn-images-1.medium.com/max/1…

  9. Medium — MLOps tag TIER_1 English(EN) · Mirav Kapadia ·

    第 02 部分 — 缩短延迟曲线：在不牺牲质量的情况下实现快速 LLM 推理的 8 个方法

    <div class="medium-feed-item"><p class="medium-feed-snippet">Sequel to &#x201c;Part 01 &#x2014; 8 Levers to Throttle the Hidden Cost Curve of LLMs&#x201d;</p><p class="medium-feed-link"><a href="https://medium.com/@miravck/part-02-throttling-the-latency-curve-8-levers-for-fast-ll…

  10. r/LocalLLaMA TIER_1 English(EN) · /u/East-Muffin-6472 ·

    文献综述：边缘LLM推理：移动端、NPU和GPU在持续负载下的性能效率权衡 | 手机LLM基准测试[R]

    <table> <tr><td> <a href="https://www.reddit.com/r/LocalLLaMA/comments/1uqmbv7/literature_review_llm_inference_at_the_edge/"> <img alt="Literature Review: LLM Inference at the Edge: Mobile, NPU, and GPU Performance Efficiency Trade-offs Under Sustained Load | Bnechmarking LLMs on…

相关实体

相关话题