MaTe: Images Are All You Need for Material Transfer via Diffusion Transformer
Researchers have introduced several advancements in Diffusion Transformer (DiT) architectures for image generation and manipulation. One paper explores the use of register tokens in pixel-space DiTs to improve convergence and generation quality, finding they produce cleaner feature maps. Another proposes HyperDiT, which uses hyper-connected cross-scale interactions and registers to bridge semantic and pixel manifolds for high-fidelity generation. ElasticDiT focuses on efficiency for mobile devices by dynamically adjusting architecture and using sparse attention, while DreamSR enhances super-resolution by combining global and local textual features. Finally, DealMaTe and MaTe simplify material transfer by eliminating text guidance and relying on image inputs within DiT frameworks. AI
IMPACT These advancements in Diffusion Transformers offer improved image generation fidelity, efficiency for mobile devices, and new capabilities in super-resolution and material transfer.