Researchers have introduced a novel learning paradigm called "Know, then Draw" for visual generation tasks. This approach separates knowledge acquisition through autoregressive pretraining from high-fidelity rendering via diffusion post-training. Experiments indicate that autoregressive pretraining is more effective for downstream rendering, enhancing both learning efficiency and final generation quality. The study also developed compute-optimal scaling laws for this paradigm, enabling the training of a 3B-parameter text-to-image model with significantly reduced computational resources. AI
IMPACT This new paradigm could lead to more efficient training of visual generation models, potentially reducing computational costs and accelerating development.
RANK_REASON The item is an academic paper detailing a new learning paradigm for visual generation. [lever_c_demoted from research: ic=1 ai=1.0]
- alphaXiv
- arXiv
- CatalyzeX
- Connected Papers
- DagsHub
- DPG Bench
- Gotit.pub
- Hugging Face
- Influence Flower
- Know, then Draw
- Litmaps
- NVIDIA H100
- ScienceCast
- scite Smart Citations
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →