English(EN)Discrete Diffusion Inference-Time Control with Nested Sequential Monte Carlo
新研究探索扩散模型优化和控制技术 · 已追踪 4 个来源
作者PulseAugur 编辑部·[6 个来源]·
研究人员正在探索扩散模型的先进方法,重点是优化采样过程和控制分布。一篇论文介绍了“优化你的采样”(OYS),这是一种贝叶斯优化技术,可调整文本到图像和修复任务的采样时间步长,从而在降低推理成本的同时显著提高质量。另一项研究提出了一个用于推理时分布控制的均场框架,为引导扩散模型走向期望分布提供了理论保证,可应用于蛋白质构象等任务。第三篇论文全面介绍了通用状态空间中的扩散模型,统一了连续和离散域,重点关注理论基础和训练原则。最后,第四篇论文解决了参数不确定性下的扩散控制问题,提出了一种分布鲁棒的贝叶斯控制公式,以减轻错误指定并改进策略评估。
AI
arXiv:2608.20123v1 Announce Type: cross Abstract: We study inference-time control for text generation in discrete diffusion language models, where the goal is to steer sampling toward sequence-level rewards without retraining. Prior work in this domain has focused on particle-bas…
arXiv cs.LG
TIER_1English(EN)·Travis Zhang, Christian Belardi, Justin Lovelace, Jin Peng Zhou, Saebyeol Shin, Carla P. Gomes, Kilian Q. Weinberger·
arXiv:2608.18040v1 Announce Type: new Abstract: Sampling from a diffusion model typically requires many forward passes through a large neural network, making generation computationally expensive. While much work has focused on efficient solvers and samplers, comparatively little …
Diffusion models are increasingly used as controllable samplers, whose generations can be steered at inference time according to a chosen reward function. While such rewards are typically defined on individual samples, for many applications it is desirable to steer according to d…
arXiv cs.CV
TIER_1English(EN)·Libo Chen, Souvik Ghosh, Teo Deveney, Chris Budd, Vinay P. Namboodiri·
arXiv:2608.19504v1 Announce Type: new Abstract: We propose a conditioning mechanism for diffusion models based on multi-speed joint diffusion of the target and the condition. The mechanism learns an unconditional joint score network and enforces conditioning at inference via a pl…
arXiv stat.ML
TIER_1English(EN)·Vincent Pauline, Tobias H\"oppe, Kirill Neklyudov, Alexander Tong, Stefan Bauer, Andrea Dittadi·
arXiv:2512.05092v2 Announce Type: replace Abstract: Although diffusion models now occupy a central place in generative modeling, introductory treatments commonly assume Euclidean data and seldom clarify their connection to discrete-state analogues. This article is a self-containe…
arXiv:2506.19294v4 Announce Type: replace-cross Abstract: We study diffusion control problems under parameter uncertainty. Controllers based on plug-in estimation can be brittle due to potential distribution shifts. Bayesian control with a prior on the parameters offers a formula…