Kernel-Aware Proxy

CoSA introduces efficient sparse attention for long-context LLMs

Researchers have developed CoSA, a novel sparse attention mechanism designed to accelerate inference for long-context language models. CoSA employs a two-stage, training-free approach that couples a Kernel-Aware Proxy (…