PulseAugur
EN
LIVE 16:05:55

New entropy method boosts generative model sample quality

Researchers have developed a new method for optimizing the discretization of generative models, aiming to improve sample quality with limited computational resources. This approach, termed conditional-marginal entropy-rate objective, separates the geometry of the probability path from the evolution of marginal distributions. Applied to flow-matching and Schrödinger bridge models, it demonstrates significant improvements in sample quality metrics like MMD and FID, particularly in low-sample regimes, and shows promise for applications like protein generation. AI

IMPACT Improves sample quality in generative models with fewer computational steps, potentially accelerating research and application development.

RANK_REASON The cluster contains two academic papers detailing novel research in generative models and information theory.

Read on arXiv cs.LG →

AI-generated summary · Google Gemini · from 3 sources. How we write summaries →

New entropy method boosts generative model sample quality

COVERAGE [3]

  1. arXiv cs.LG TIER_1 English(EN) · Luca Ambrogioni ·

    Entropy Across the Bridge: Conditional-Marginal Discretization for Flow and Schrödinger Samplers

    For a fixed flow-based generative model under a small inference budget, sample quality can depend strongly on where the sampler spends its few function evaluations. Flow matching and Schrödinger bridges define probability paths, yet their inference grids are usually heuristic or …

  2. arXiv stat.ML TIER_1 English(EN) · Shahab Asoodeh, Jun Chen ·

    Breaking the Finite-Sample Barrier in Entropy Coupling

    arXiv:2605.16229v1 Announce Type: cross Abstract: Dependence among marginally constrained observations can break a finite-sample barrier. To formalize this phenomenon, we introduce the \emph{minimum list entropy coupling} $H(P\|Q_1,\dots,Q_m)$, the minimum conditional entropy $H(…

  3. arXiv stat.ML TIER_1 English(EN) · Jun Chen ·

    Breaking the Finite-Sample Barrier in Entropy Coupling

    Dependence among marginally constrained observations can break a finite-sample barrier. To formalize this phenomenon, we introduce the \emph{minimum list entropy coupling} $H(P\|Q_1,\dots,Q_m)$, the minimum conditional entropy $H(X|Y_1,\dots,Y_m)$ over all joint distributions wit…