English(EN)A note on connections between the Föllmer process and the denoising diffusion probabilistic model
新研究将Föllmer过程与DDPM联系起来,提高了采样效率
作者PulseAugur 编辑部·[13 个来源]·
研究人员探讨了Föllmer过程与去噪扩散概率模型(DDPM)之间的联系,发现离散化Föllmer过程可以为DDPM采样器产生最优的超参数设置。这种方法在Wasserstein距离和KL散度方面取得了改进的误差界限。此外,还提出了一种名为前向学习离散扩散(FLDD)的新方法,该方法学习加噪过程以实现更快、少步数的优质样本生成。
AI
The Föllmer process is a Brownian motion conditioned to have a pre-specified distribution at time 1. This process can be interpreted as an "augmented" time-compressed version of the reverse stochastic differential equation (SDE) for the denoising diffusion probabilistic model (DD…
arXiv stat.ML
TIER_1English(EN)·Benedikt L\"utke Schwienhorst, Nadja Klein, Johannes Lederer·
arXiv:2605.22950v1 Announce Type: new Abstract: Score matching is an alternative to maximum likelihood estimation when the normalizing constant is unknown or too costly to evaluate. However, vanilla score matching has shown to be inefficient relative to maximum likelihood estimat…
arXiv stat.ML
TIER_1English(EN)·Samson Gourevitch, Yazid Janati, Dario Shariatian, Umut Simsekli, Eric Moulines, Eric P. Xing, Alain Durmus·
arXiv:2605.22765v1 Announce Type: cross Abstract: Discrete diffusion models are often trained through clean-data prediction, but the prediction can be used in different ways to define the reverse dynamics. In Masked Diffusion Models (MDM) these choices largely coincide, whereas i…
Score matching is an alternative to maximum likelihood estimation when the normalizing constant is unknown or too costly to evaluate. However, vanilla score matching has shown to be inefficient relative to maximum likelihood estimation for multimodal distributions with well-separ…
Discrete diffusion models are often trained through clean-data prediction, but the prediction can be used in different ways to define the reverse dynamics. In Masked Diffusion Models (MDM) these choices largely coincide, whereas in Uniform Diffusion Models (UDM) they do not. We s…
arXiv:2510.03824v2 Announce Type: replace-cross Abstract: The task of learning a diffusion-based neural sampler for drawing samples from an unnormalized target distribution can be viewed as a stochastic optimal control problem on path measures. However, the training of neural sam…
arXiv stat.ML
TIER_1English(EN)·Yifan Chen, Eric Vanden-Eijnden·
arXiv:2602.10989v2 Announce Type: replace-cross Abstract: We construct and analyze generative diffusions that transport a point mass to a prescribed target distribution over a finite time horizon using the stochastic interpolant framework. The drift is expressed as a conditional …
arXiv:2605.18040v1 Announce Type: new Abstract: The F\"ollmer process is a Brownian motion conditioned to have a pre-specified distribution at time 1. This process can be interpreted as an "augmented" time-compressed version of the reverse stochastic differential equation (SDE) f…
arXiv:2605.18069v1 Announce Type: new Abstract: This paper studies sampling error bounds for denoising diffusion probabilistic models (DDPMs) in the 2-Wasserstein distance. Our contributions are threefold. (i) Under general Lipschitz-type conditions on the score function and for …
arXiv stat.ML
TIER_1English(EN)·Grigory Bartosh, Teodora Pandeva, Sushrut Karmalkar, Javier Zazo·
arXiv:2605.18204v1 Announce Type: new Abstract: Discrete diffusion models are a powerful class of generative models with strong performance across many domains. For efficiency, however, discrete diffusion typically parameterizes the generative (reverse) process with factorized di…
Discrete diffusion models are a powerful class of generative models with strong performance across many domains. For efficiency, however, discrete diffusion typically parameterizes the generative (reverse) process with factorized distributions, which makes it difficult for the mo…
This paper studies sampling error bounds for denoising diffusion probabilistic models (DDPMs) in the 2-Wasserstein distance. Our contributions are threefold. (i) Under general Lipschitz-type conditions on the score function and for a broad class of variance schedules, including t…
The Föllmer process is a Brownian motion conditioned to have a pre-specified distribution at time 1. This process can be interpreted as an "augmented" time-compressed version of the reverse stochastic differential equation (SDE) for the denoising diffusion probabilistic model (DD…