RobuQ framework enables Diffusion Transformers to run at ultra-low bit precision

Researchers have developed RobuQ, a new framework designed to significantly reduce the computational and memory costs associated with Diffusion Transformers (DiTs) for image generation. This method focuses on robust activation quantization, enabling DiTs to operate at extremely low bit settings, specifically achieving stable image generation on ImageNet-1K with activations quantized to an average of 2 bits. The framework introduces novel techniques like RobustQuantizer and an Activation-only Mixed-Precision Network pipeline to overcome the challenges of quantizing DiT activations. AI

Summary written by gemini-2.5-flash-lite from 1 source. How we write summaries →

IMPACT Enables more efficient deployment of Diffusion Transformers for image generation, potentially lowering hardware requirements.

RANK_REASON The cluster contains an academic paper detailing a new method for optimizing AI models. [lever_c_demoted from research: ic=1 ai=1.0]

Read on arXiv cs.CV →

• Diffusion Transformers
• ImageNet-1K
• Kaicheng Yang
• RobuQ

• paper
• infra