实体 Kwai Summary Attention

Kwai Summary Attention

PulseAugur coverage of Kwai Summary Attention — every cluster mentioning Kwai Summary Attention across labs, papers, and developer communities, ranked by signal.

Show in brief

总计 · 30天

90 天内 1

发布 · 30天

90 天内 0

论文 · 30天

90 天内 1

层级分布 · 90 天

最近 · 第 1/1 页 · 共 1 条

RESEARCH · CL_06270 · Apr 27 · 12:59

Kwai Summary Attention compresses historical contexts for efficient long-context LLMs

Researchers have introduced Kwai Summary Attention (KSA), a novel attention mechanism designed to address the quadratic time complexity of standard softmax attention in large language models. KSA aims to maintain a line…

Kwai Summary Attention compresses historical contexts for efficient long-context LLMs