JIAYI YUAN

BLASST paper introduces dynamic sparse attention for faster LLM inference

Researchers have developed BLASST, a novel sparse attention mechanism designed to accelerate inference for large language models with long contexts. This drop-in solution dynamically skips attention blocks using a simpl…