early-stopping algorithm

Sparse attention in LLMs can paradoxically increase complexity, new paper finds

Researchers have identified a phenomenon called "Less is Less" (Lil) where applying post-training sparse-attention algorithms to large language models can paradoxically increase inference complexity and latency. This oc…