Two new research papers propose methods to accelerate Diffusion Transformers (DiTs), which are computationally intensive for high-resolution image and video generation. The first paper, Shiva-DiT, introduces a residual-based differentiable top-k selection method that allows for end-to-end learnability and deterministic token counts, achieving up to 1.54x speedup on SD3-Medium with competitive fidelity. The second paper, BaryCache, presents a training-free acceleration technique using a barycentric extrapolator that forecasts sampling steps, offering a favorable trade-off between memory usage and perceptual quality, with up to 3.30x speedup. AI
IMPACT These methods could significantly reduce the computational cost and latency of generating high-resolution images and videos with Diffusion Transformers.
RANK_REASON Two academic papers published on arXiv proposing novel methods for accelerating Diffusion Transformers.
- arXiv
- BaryCache
- Barycentric Extrapolator
- DagsHub
- Diffusion Transformer
- Diffusion Transformers
- Hugging Face
- Runge phenomenon
- Flux
- Jiaji Zhang
- PixArt
- SD3-Medium
- Shiva-DiT
AI-generated summary · Google Gemini · from 2 sources. How we write summaries →