PulseAugur
实时 22:16:14

New theory resolves instability in MeanFlow generative models

Researchers have developed a theoretical framework to address instability issues in MeanFlow training, a one-step generative modeling technique. They identified that the conditional velocity field is misused in the loss function, playing two statistical roles with an incorrect coefficient. The study derives the optimal coefficient, demonstrating that various concurrent fixes are practical implementations of this optimum. Applying this optimized coefficient significantly improves sample quality and leads to a monotonic FID trend in latent Diffusion Transformers. AI

影响 Introduces a theoretical fix for instability in MeanFlow training, potentially improving sample quality and model performance in generative AI.

排序理由 The cluster contains an academic paper detailing theoretical advancements and experimental validation in a specific machine learning technique. [lever_c_demoted from research: ic=1 ai=1.0]

在 arXiv stat.ML 阅读 →

AI 生成摘要 · Google Gemini · 来自 1 个来源。 我们如何撰写摘要 →

New theory resolves instability in MeanFlow generative models

报道来源 [1]

  1. arXiv stat.ML TIER_1 English(EN) · Ziran Wang ·

    On Variance Reduction in Learning Mean Flows

    One-step generative modeling has emerged as a leading approach to amortize the inference cost of diffusion and flow-matching models. Among distillation-free methods, MeanFlow training is notoriously unstable, with non-decreasing loss and unbounded gradient variance. In this work,…