Step-dLLM

Step-dLLM boosts diffusion LLM inference speed with adaptive sparse attention

Researchers have developed Step-dLLM, a novel method to improve the efficiency of diffusion large language models (dLLMs) during inference. Unlike autoregressive models, dLLMs cannot use KV caching and recompute attenti…