PulseAugur
中
实时 08:34:42
English(EN) Kernel Ridge Attention: Nonlinear Memory with Selective Forgetting

Kernel Ridge Attention 引入了具有选择性遗忘的非线性记忆

研究人员推出了一种新颖的循环序列混合器 Kernel Ridge Attention (KRA),旨在增强非线性特征学习和记忆更新。KRA 利用递归岭回归和过去键之间的相关性来管理新观测如何修改记忆,并结合了内容相关的转换以实现保留和不确定性恢复。这种方法允许精确的时间核解释,并保持与上下文长度无关的推理状态,在语言建模实验中显示出比现有注意力和循环方法更高的预测质量和联想回忆能力。 AI

影响 引入了一种新的序列建模方法,有望提高语言任务的性能。

排序理由 该项目是一篇详细介绍新模型架构的学术论文。 [lever_c_demoted from research: ic=1 ai=1.0]

在 arXiv cs.LG 阅读 →

AI 生成摘要 · Google Gemini · 来自 1 个来源。 我们如何撰写摘要 →

Kernel Ridge Attention 引入了具有选择性遗忘的非线性记忆

本文如何被排名

Signal score
21 / 100
Composite score across the factors below. Higher = stronger signal that this story matters right now.
Newsworthiness bucket
Tool
该项目是一篇详细介绍新模型架构的学术论文。 [lever_c_demoted from research: ic=1 ai=1.0]
Source corroboration
Single-source cluster
Only one publisher covered this so far. Single-source stories can still rank when the publisher is high-authority, but they lack cross-source corroboration.
Topics
paper, model release
Editorial topic classification. Feeds into how the story surfaces on /topic/<slug> hub pages and into the per-entity coverage mix.
AI-industry relevance
High
Clearly on-topic for AI-industry coverage.
Story freshness
Breaking (< 6h)
Fresh story with cross-source coverage still developing. Ranking may shift as more sources report.

完整方法见我们的编辑标准。

报道来源 [1]

  1. arXiv cs.LG TIER_1 English(EN) · Haowei Chen, Yichen Wang, Congfu Xu ·

    Kernel Ridge Attention:具有选择性遗忘的非线性记忆

    arXiv:2611.23896v1 Announce Type: new Abstract: Kernel Ridge Attention (KRA) is a recurrent sequence mixer that combines learned nonlinear features with covariance-guided memory updates. It stores associations through recursive ridge regression, using correlations among past keys…