研究人员推出了一种新颖的内容感知循环架构CARVE，旨在提高大型语言模型的内存效率和性能。CARVE通过实现内存无关门控和优化参数使用，解决了现有delta-rule架构中的三个关键缺陷。与前代模型GDN-2相比，新模型在常识推理和检索基准测试中表现更优，同时还减小了内存占用和参数数量。 AI
影响 CARVE的效率提升有望以更低的计算成本实现更大、更强大的循环模型。
排序理由 该集群包含一篇详细介绍新模型架构的研究论文。
在 arXiv cs.NE (Neural & Evolutionary) 阅读 →
AI 生成摘要 · Google Gemini · 来自 2 个来源。 我们如何撰写摘要 →
arXiv:2606.27229v1 Announce Type: cross Abstract: Recurrent models must forget in order to remember, yet the state of the art decides what to erase without consulting what is stored -- the gate sees only the arriving token, not the memory it is about to modify. This memory-blind …
Recurrent models must forget in order to remember, yet the state of the art decides what to erase without consulting what is stored -- the gate sees only the arriving token, not the memory it is about to modify. This memory-blind gating is one of three coupled defects in the lead…