Researchers have developed PISA, a new training-free method for Piecewise Sparse Attention designed to improve the efficiency of Diffusion Transformers. PISA addresses the quadratic complexity of attention in these models by approximating non-critical attention blocks using Taylor expansion, rather than discarding them. This approach allows for significant speedups without sacrificing quality, demonstrated by achieving 1.91x and 2.57x acceleration on the Wan2.1-14B and Hunyuan-Video models, respectively, and a 1.2x acceleration on FLUX for image generation. AI
IMPACT This method could lead to faster and more efficient image and video generation models.
RANK_REASON The cluster contains an academic paper detailing a new method for improving AI model efficiency. [lever_c_demoted from research: ic=1 ai=1.0]
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →