Diffusion models advance with new architectures and training methods · 10 sources tracked
ByPulseAugur Editorial·[129 sources]·
Researchers are exploring advanced diffusion models across various domains, including tri-modal generation for text, images, and audio by Apple, and data-free training methods for lattice field theories using diffusion models. PixelMoE introduces Mixture of Experts to pixel-space diffusion for efficient scaling, while the Bridge Matching Sampler offers scalable and stable sampling from unnormalized densities. New transformer-based approaches enable in-context learning for diffusion models to adapt to unseen distributions, and -Flow generalizes diffusion and flow-based models for inverse problems. Additionally, CacheScope accelerates diffusion transformer inference through training-free feature reuse, and DiffusionART enhances reinforcement learning for diffusion models by improving efficiency and stability.
AI
IMPACT
These advancements push the boundaries of generative AI, enabling more efficient, scalable, and adaptable models for diverse applications.
RANK_REASON
Multiple research papers detailing novel methods and architectures for diffusion models.
Discrete diffusion models have emerged as strong alternatives to autoregressive language models, with recent work initializing and finetuning a base unimodal model for bi-modal generation. Diverging from previous approaches, we introduce the first tri-modal Masked Diffusion Model…
arXiv:2610.23122v1 Announce Type: cross Abstract: Diffusion large language models (dLLMs) have emerged as a promising alternative to autoregressive language models, enabling non-autoregressive text generation through parallel decoding. Existing dLLMs can be broadly categorized in…
arXiv:2610.22380v1 Announce Type: new Abstract: Continuous diffusion treats the forward process as a design space; discrete language diffusion often uses absorbing corruption, leaving context fully trusted throughout generation. This makes trust binary: corrupted context is copie…
arXiv:2610.22945v1 Announce Type: new Abstract: Large-scale diffusion models are commonly trained with a constant learning rate (LR) and exponential moving average (EMA), despite the strong performance of LR decay and Schedule-Free optimization in training large language models. …
arXiv cs.LG
TIER_1English(EN)·Qinyu Li, Yee Whye Teh, Chris Holmes, Joel Jaskari·
arXiv:2610.23289v1 Announce Type: new Abstract: Machine learning with limited data is susceptible to overfitting, especially with modern deep neural networks. Prior to the introduction of AlexNet, reconstruction-based pretraining with auto-encoder and denoising auto-encoder were …
arXiv cs.LG
TIER_1English(EN)·Alberto Foresti, Giulio Franzese, Pietro Michiardi·
arXiv:2610.23404v1 Announce Type: new Abstract: Information-theoretic measures, such as Mutual Information (MI), play a crucial role in understanding non-linear relationships between random variables and are widely used across scientific disciplines. Yet, their use on real-world …
arXiv:2610.23047v1 Announce Type: cross Abstract: On AWS Trainium2, every component of a diffusion model runs as a program compiled ahead of time for fixed shapes, while pipelines differ across models, prompt lengths across requests, and caching decisions across denoising steps. …
arXiv cs.LG
TIER_1English(EN)·Samuel Cognolato, Luciano Serafini, Alessandro Sperduti, Andrea Cavallaro·
arXiv:2610.23766v1 Announce Type: new Abstract: Graph diffusion models are competitive approaches for generating complex graph-structured data. However, when such distributions have strict structural constraints, diffusion models may fail to capture them exactly, resulting in the…
arXiv:2510.03419v3 Announce Type: replace-cross Abstract: Neural diffusion processes provide a scalable, non-Gaussian approach to modelling distributions over functions, but existing formulations are limited to single-task inference and do not capture dependencies across related …
arXiv cs.AI
TIER_1English(EN)·Zhe Xu, Mingfu Liang, Kavosh Asadi, Jean-Pascal Billaud, Tianyi Chen, Yanhui Guo, Christina Huang, Baekjin Kim, Jimmy Kim, Yufei Li, Daqi Sun, Jiachen Sun, Dian Yu, Zaiwei Zhang, Kaushik Rangadurai, Frank Shyu, Sandeep Pandey, Xi Liu, Luke Simon·
arXiv:2610.20635v1 Announce Type: cross Abstract: Permutation generation with language models requires both text-conditioned ranking and a global one-to-one assignment between candidates and output positions. We study this problem through three diffusion-LLM parameterizations: ha…
arXiv:2610.20999v1 Announce Type: cross Abstract: Diffusion models are notoriously expensive to train, requiring large-scale datasets to learn how to gradually reverse the noise from images over multiple small denoising steps. Current approaches focus on distilling the number of …
arXiv:2610.22330v1 Announce Type: new Abstract: Continuous diffusion language models (CDLMs) offer an alternative approach to parallel language generation; however, most existing studies directly use transformer architectures from either causal large language models (LLMs) or Dif…
arXiv cs.AI
TIER_1English(EN)·Jaehyeon Kim, Ziseok Lee, Siyoung Choi, Kyungsu Kim·
arXiv:2610.20669v1 Announce Type: new Abstract: Reward-guided discrete diffusion enables test-time alignment with downstream objectives, but applying Sequential Monte Carlo (SMC) guidance at every denoising step is computationally expensive. Active guidance steps require addition…
arXiv:2610.21061v1 Announce Type: cross Abstract: Discrete diffusion models have become a powerful framework for modeling complex discrete distributions across a range of applications. While theoretical convergence guarantees depend on consistency between the target and training …
arXiv cs.LG
TIER_1English(EN)·Huitao Yang, Oscar Hernan Madrid Padilla·
arXiv:2610.20979v1 Announce Type: cross Abstract: Generative modeling across related distributions raises a question: how can shared structure support accurate generation for a target distribution with limited observations? We develop a statistical framework for diffusion transfe…
arXiv cs.LG
TIER_1English(EN)·Yingheng Wang, Yaoqiang Li, Yaqin Wu, Junwen Bai, Jiatao Gu, Christopher De Sa, Volodymyr Kuleshov·
arXiv:2610.20761v1 Announce Type: cross Abstract: Representation alignment improves and accelerates diffusion training by encouraging intermediate features to match a pretrained visual encoder. However, standard alignment matches pretrained representations without distinguishing …
arXiv:2610.22238v1 Announce Type: new Abstract: Masked diffusion models (MDMs) accelerate generation by unmasking multiple tokens in parallel, but sampling these tokens independently ignores their correlations and biases the output. Anari et al. (2026) corrected this bias with re…
arXiv cs.LG
TIER_1English(EN)·Anand Jerry George, Nicolas Macris·
arXiv:2610.20850v1 Announce Type: new Abstract: Architectural biases restrict the class of functions that a diffusion score network can represent, but their effect on generalization remains poorly understood. We study denoising score matching with score networks having a rank con…
arXiv cs.AI
TIER_1English(EN)·Jieke Wu, Qijie Zhu, Weimin Wu, Zeqi Ye, Minshuo Chen, Han Liu·
arXiv:2610.04938v2 Announce Type: replace-cross Abstract: We propose D-DOIT (Discrete Doob-Oriented Inference-time Transformation), a training-free and efficient adaptation method for discrete diffusion models with generic rewards. D-DOIT formulates adaptation as sampling from a …
arXiv cs.AI
TIER_1English(EN)·Gaurav Rudravaram, Lianrui Zuo, Ema Topolnjak, Michael E. Kim, Adam M. Saunders, Elyssa M. McMaster, Paula Trujillo, Ely E. Wesley, Colin D. McKnight, Pratik P. Pandharipande, Mayur B. Patel, Cayce Strength, Brenda T. Pund, Amelia W Maiga, Robert S. Ditt…·
arXiv:2610.17401v1 Announce Type: new Abstract: Incomplete field-of-view (FOV) diffusion MRI (dMRI) acquisitions compromise whole-brain white matter analysis by excluding brain regions from tractography and connectivity studies. While deep generative models for dMRI FOV extension…
arXiv:2610.14693v1 Announce Type: new Abstract: Explicit point correspondence is attractive for adapting video generators: it describes how visible surfaces move, but can overwrite the appearance prior learned by a large pretrained model. We study this tension in a 5.01B-paramete…
arXiv cs.AI
TIER_1English(EN)·Donghoon Ahn, Runqian Wang, Alexei A. Efros, Taesung Park, Yash Belhe·
arXiv:2610.14136v2 Announce Type: new Abstract: Iterative sampling in diffusion models can lead to error accumulation due to exposure bias. The denoiser is trained on real images interpolated with noise, but at inference its inputs are constructed from its own imperfect predictio…
arXiv:2610.19802v1 Announce Type: new Abstract: Negative guidance of diffusion models generates samples that avoid an undesired condition, specified either by reference samples or by a conditional score alongside an unconditional model. Existing methods inject repulsive terms der…
arXiv:2610.19692v1 Announce Type: new Abstract: Gaussian diffusion models offer a practical framework for generative modeling. Denoising L\'{e}vy Probabilistic Models (DLPM) introduce heavy-tailed perturbations with a fixed tail index throughout denoising. We introduce Annealed L…
arXiv:2610.19042v1 Announce Type: new Abstract: Understanding the mechanism behind why diffusion models memorize their training data remains an open question in generative modeling. In this paper, we examine this question from two perspectives: (a) the model-level perspective con…
arXiv cs.CL
TIER_1English(EN)·Yangyi Shen, Pin-Jui Ku, Nicolai Oswald, Jean-Marie Lemercier, Yonggan Fu, Stefano Ermon, Jure Leskovec, Boris Ginsburg, Ante Juki\'c·
arXiv:2610.19510v1 Announce Type: new Abstract: Block-diffusion language models denoise a whole block of token positions in parallel so each forward pass can emit many tokens. However, blocks are still denoised in strict sequence, a cost that within-block acceleration leaves unto…
arXiv cs.AI
TIER_1English(EN)·Daniel Mensing, Jan Kapar, Jochen G. Hirsch, Matthias G\"unther, Horst Hahn, Marvin N. Wright·
arXiv:2605.06699v2 Announce Type: replace-cross Abstract: We propose a multimodal latent diffusion model that jointly synthesizes volumetric magnetic resonance imaging (MRI) and tabular clinical data within a shared latent space via cross-attention. This approach enables coherent…
arXiv cs.AI
TIER_1English(EN)·Desen Sun, Jason Hon, Jintao Zhang, Sihang Liu·
arXiv:2603.07815v3 Announce Type: replace-cross Abstract: Iterative diffusion generation requires different amounts of model capacity at different token positions. Prior model combinations allocate capacity by denoising step or by drafting and verification role. We present Hybrid…
arXiv cs.AI
TIER_1English(EN)·Jiahao Kuang, Yangfan Gao, Tao Gui, Yuanbin Wu, Qi Zhang, Xuanjing Huang, Tao Ji·
arXiv:2610.18200v1 Announce Type: cross Abstract: Parallel generation is widely regarded as an inherent advantage of diffusion large language models. Yet our fixed-quota evaluation of four representative models reveals severe degradation across mathematics and code, with all scor…
arXiv cs.AI
TIER_1English(EN)·Miao Li, Hanyang Jiang, Hengyu Fu, Baihe Huang, Yating Liu, Yuhang Cai, Changkun Guan, Zhongzhu Chen, Jiecheng Lu, Michael A. Boateng, Pascal Van Hentenryck·
arXiv:2610.18001v1 Announce Type: cross Abstract: Diffusion language models (DLMs) enable flexible parallel generation by resolving tokens according to the model's evolving predictability rather than a fixed left-to-right order. This flexibility, however, introduces training choi…
arXiv cs.AI
TIER_1English(EN)·Jiyue Jiang, Zhiyu Huo, Yuhan Chen, Yanruisheng Shao, Gong Zhang, Lei Deng·
arXiv:2610.16545v1 Announce Type: cross Abstract: Feature caching has become a mainstream training-free strategy for accelerating video diffusion models by reusing intermediate outputs across denoising steps. However, existing adaptive methods rely on heuristic difference measure…
arXiv cs.AI
TIER_1English(EN)·Hannah Janmohamed, Joao Correia, Penousal Machado, Antoine Cully·
arXiv:2610.15724v1 Announce Type: cross Abstract: Denoising Diffusion Probabilistic Models have emerged as powerful generative priors across domains ranging from molecular design to high-resolution image synthesis. However, standard diffusion sampling is inherently biased toward …
arXiv:2610.14654v1 Announce Type: cross Abstract: Autoregressive video generators synthesize long videos through chunk-wise rollouts, yet they are typically trained to predict only the immediate future. This limited prediction horizon makes it challenging to maintain video qualit…
arXiv cs.AI
TIER_1English(EN)·Longhao Lei, Lan Yao·
arXiv:2610.13997v1 Announce Type: cross Abstract: Concept representations in diffusion models drift across network depth and denoising time, yet existing sparse autoencoders offer only per-block or per-timestep dictionaries, leaving no single feature dictionary for localization a…
arXiv cs.AI
TIER_1English(EN)·Barak Itzchak Davidovitch, Eli Meirom, Ethan Fetaya, Gal Chechik·
arXiv:2610.17192v1 Announce Type: new Abstract: Routing problems, like the Traveling Salesman Problem (TSP) and the Capacitated Vehicle Routing Problem (CVRP), are NP-hard and slow to solve for large instances. Diffusion-based solvers can be trained in a supervised way using sets…
arXiv cs.LG
TIER_1English(EN)·Thibaut Pellerin, Alain Durmus, Elinor Berger, Eric Barat·
arXiv:2610.20218v1 Announce Type: cross Abstract: Diffusion models are a powerful framework for learning complex probability distributions. While widely used diffusion models for continuous data rely on Gaussian noising processes, we instead develop diffusion models based on Pois…
arXiv:2610.19020v1 Announce Type: cross Abstract: Discrete diffusion models have emerged as a leading alternative to autoregressive models for generating text and other categorical data, yet their theoretical foundations remain less developed than those of their continuous counte…
Autoregressive generation underlies real-time, causal video synthesis and is the backbone of video world models. Today's dominant approach distills a bidirectional diffusion model into a causal few-step student, but existing pipelines make this conversion prohibitively expensive,…
Glance Forcing improves video generation efficiency by splitting denoising into specialized experts guided by stage-specific objectives, reducing training costs while improving quality.
Understanding the mechanism behind why diffusion models memorize their training data remains an open question in generative modeling. In this paper, we examine this question from two perspectives: (a) the model-level perspective concerning the onset of memorization in a model dur…
Sampling equilibrium field configurations remains a major computational bottleneck in lattice field theory, motivating the development of generative samplers that can produce independent configurations. Diffusion models are promising for this purpose, but their standard denoising…
Pixel-space diffusion models provide an appealing alternative to latent-space diffusion models by directly modeling raw images without relying on a learned tokenizer. However, scaling pixel-space models has predominantly followed dense strategies, tightly coupling model capacity …
Diffusion language models (DLMs) enable flexible parallel generation by resolving tokens according to the model's evolving predictability rather than a fixed left-to-right order. This flexibility, however, introduces training choices absent from standard autoregressive teacher fo…
Inference-time alignment steers diffusion models toward downstream objectives without costly fine-tuning, but existing methods typically optimize expected cost (or reward) without explicitly controlling tail risk. In this work, we propose a risk-averse framework for inference-tim…
arXiv:2610.13690v1 Announce Type: new Abstract: Diffusion models typically learn the generative dynamics of a single target distribution or a family of distributions indexed by conditioning variables fixed during training. This limits their ability to adapt to a previously unseen…
arXiv cs.LG
TIER_1English(EN)·Zhenglin Wan, Jiayu Chen, Zhengfeiyang Zhang, Pengfei Zhou, Wangbo Zhao, Fangyuan Kong, Pengfei Wan, Kun Gai, Yang You·
arXiv:2610.12572v1 Announce Type: new Abstract: Online reinforcement learning (RL) fine-tunes diffusion models with black-box rewards, but reverse-process methods such as Flow-GRPO are limited in efficiency by poor credit assignment, while forward-process methods such as Diffusio…
arXiv:2610.12530v1 Announce Type: new Abstract: Training-free feature reuse accelerates diffusion transformer inference by replacing full denoising computation at selected steps with cached approximations. Existing methods mainly improve the reconstruction of skipped features, bu…
arXiv:2610.13812v1 Announce Type: new Abstract: Flow-matching and diffusion models are increasingly used as priors for linear inverse problems, however, most methods are bespoke to one class of trajectory prior. Plug-and-play methods have been proposed, however these implicitly d…
arXiv cs.LG
TIER_1English(EN)·Denis Blessing, Lorenz Richter, Julius Berner, Egor Malitskiy, Gerhard Neumann·
arXiv:2603.00530v2 Announce Type: replace Abstract: Sampling from unnormalized densities using diffusion models has emerged as a powerful paradigm. However, while recent approaches that use least-squares `matching' objectives have improved scalability, they often necessitate sign…
Generating images beyond the training resolution of Diffusion Transformers (DiTs) remains challenging, as the number of tokens grows rapidly with resolution, full attention becomes expensive, and outputs often suffer from structural distortions and degraded detail. We identify un…
arXiv cs.LG
TIER_1English(EN)·Adam Perbost, Francis Bach, Pierre Marion·
arXiv:2610.12052v1 Announce Type: cross Abstract: Despite their empirical success, why diffusion models overcome the bottlenecks of classical score-based samplers remains unclear. In this work, we leverage Gaussian distributions to isolate this phenomenon. We establish 2-Wasserst…
arXiv cs.AI
TIER_1English(EN)·Wei Guo, Yaowen Zhang, Xingtong Ge, Jun Zhang·
arXiv:2610.11380v1 Announce Type: new Abstract: Diffusion models have achieved remarkable success in generative modeling, with their sampling procedures routinely modified to control generation and improve efficiency. These modifications introduce perturbations along the sampling…
arXiv:2610.11479v1 Announce Type: cross Abstract: Causal video diffusion models generate video autoregressively, which suits streaming, interactive, and long-video generation. Under standard training, however, they often yield lower generation quality than bidirectional models of…
arXiv:2511.05940v3 Announce Type: replace-cross Abstract: Score-based diffusion models have emerged as a powerful class of generative methods, with successful applications across diverse domains. Despite their empirical success, their mathematical foundations remain only partiall…
arXiv:2610.10550v1 Announce Type: new Abstract: Personalizing text-to-image diffusion models from a few reference images requires preserving subject identity while following prompts that describe new contexts. Full-model fine-tuning is parameter-intensive, whereas low-rank adapta…
arXiv cs.LG
TIER_1English(EN)·Gwangho Kim, Sungyoon Lee·
arXiv:2610.11288v1 Announce Type: new Abstract: Conditional diffusion models generate diverse, novel, and high-quality samples under prescribed conditions. However, theoretical understanding of their memorization and generalization remains limited, while recent works have charact…
arXiv:2610.11315v1 Announce Type: new Abstract: In diffusion transformers, low-rank branches can mitigate 4-bit weight--activation (W4A4) post-training quantization (PTQ) loss by decomposing each weight into a low-bit residual and a high-precision low-rank component. Existing low…
arXiv cs.LG
TIER_1English(EN)·Nikhil Verma, Siddharthan Dileep, Anoop Singh, Srikanth Sastry, Ramya Hebbalaguppe, Sayan Ranu, N. M. Anoop Krishnan·
arXiv:2610.11670v1 Announce Type: new Abstract: Diffusion models generalize early in training and later reproduce individual training samples. Standard tests detect memorization only once one-shot generation produces near-copies, leaving a released model unaudited until its outpu…
arXiv:2610.12340v1 Announce Type: new Abstract: We introduce RefineMix, a framework for training discrete diffusion models under severe data scarcity, a common constraint in scientific applications. RefineMix uses out-of-distribution data at selected diffusion times to improve ge…
arXiv cs.LG
TIER_1English(EN)·Radmehr Karimian, Ali Mohades, Johannes Lederer·
arXiv:2610.10640v1 Announce Type: cross Abstract: Diffusion samplers can reduce computation by generating selected spectral coordinates and filling the remaining directions with noise. How many directions must they retain? We study this question for data with power-law covariance…
arXiv:2610.11407v1 Announce Type: cross Abstract: Synthetic tabular generators are commonly optimized for distributional fidelity, but statistical similarity alone does not guarantee preservation of causal effects. In this paper, we study whether causal fidelity can be improved d…
arXiv cs.LG
TIER_1English(EN)·Tim Kaiser, Markus Kollmann·
arXiv:2603.13419v3 Announce Type: replace Abstract: Diffusion models generalize well in practice. Paradoxically, an optimal diffusion model fully memorizes the training data and therefore fails to generalize, raising the question of what induces generalization in a real diffusion…
Visual representations are largely developed for understanding, yet what makes them useful for generation remains unclear. We study this question in pixel diffusion transformers and uncover two key insights. First, better representation quality does not necessarily translate into…
arXiv cs.LG
TIER_1English(EN)·Tongtong Liang, Siqi Kou, Ziqiao Xi, Esha Singh, Kun Zhou, Zhijie Deng, Alexander Cloninger, Yu-Xiang Wang, Rahul Parhi·
arXiv:2609.33895v2 Announce Type: replace-cross Abstract: In diffusion-based generation, a neural network can be trained to predict the clean data, the noise, or the velocity from a noisy input. These prediction targets are interconvertible and describe the same generative proces…
arXiv cs.LG
TIER_1English(EN)·Samuel Hurault, Thomas Moreau, Gabriel Peyr\'e·
arXiv:2605.08392v2 Announce Type: replace Abstract: Practical diffusion sampling requires simulating a reverse-time ODE or SDE with a limited number of denoising steps, making the choice of sampling parameters crucial for minimizing discretization error. Non-asymptotic convergenc…
arXiv:2610.09221v1 Announce Type: new Abstract: Flow and diffusion models suffer from slow inference due to computationally expensive numerical integration. Distillation provides a promising way for a student model to learn from a teacher's dynamics, enabling one-step or few-step…
arXiv cs.LG
TIER_1English(EN)·Xinsong Feng, Peng Du, Zhizhuo Yang, Daniel M. Bikel, Jiayun Wang, Haipeng Chen·
arXiv:2610.09311v1 Announce Type: new Abstract: Diffusion language models (DLMs) generate text through iterative parallel refinement, offering the potential for higher throughput than autoregressive (AR) decoding. However, most DLMs still maintain one generative state per token, …
arXiv cs.LG
TIER_1English(EN)·So Takao, Gregory David Bellchambers, Luke Ye, Sanmitra Ghosh, Michalis Michaelides·
arXiv:2610.09407v1 Announce Type: new Abstract: Pretrained diffusion models are powerful priors for inverse problems, but posterior sampling under nonlinear, non-differentiable forward models remain hard. We introduce diffusion waltz, an MCMC method using SDEdit-style noising-den…
arXiv cs.LG
TIER_1English(EN)·Honglei Brinkmann, Carola-Bibiane Sch\"onlieb, Ander Biguri·
arXiv:2610.08866v1 Announce Type: cross Abstract: Sparse-view computed tomography (CT) reduces radiation dose and acquisition time and may mitigate motion artifacts. However, angular undersampling provides insufficient information to determine the image uniquely and stably. Limit…
arXiv:2610.09045v1 Announce Type: cross Abstract: We study the problem of learning transition kernels for time-homogeneous jump-diffusion processes using conditional diffusion models, with the goal of generating new sample paths from training data consisting of N independent traj…
arXiv:2610.09166v1 Announce Type: cross Abstract: Standard diffusion samplers generate samples through repeated evaluations of a learned score function. Parallel sampling methods seek to accelerate generation by trading additional evaluations for fewer sequential rounds. This rai…
arXiv cs.LG
TIER_1English(EN)·Dai Hai Nguyen, Duc Dung Nguyen·
arXiv:2610.10187v1 Announce Type: cross Abstract: Split Gibbs sampling (SGS) is a popular framework for posterior sampling in Bayesian imaging inverse problems. It decouples a Gaussian data-fidelity term from a complex prior through an auxiliary variable, so the data variable is …
arXiv cs.LG
TIER_1English(EN)·Chenguang Duan, Johannes Hertrich, Gabriele Steidl·
arXiv:2610.10278v1 Announce Type: cross Abstract: We propose a neural algorithm for sampling from distributions specified by unnormalized Boltzmann densities. Our approach is based on the Jordan--Kinderlehrer--Otto scheme for the Kullback--Leibler divergence in the Wasserstein--F…
arXiv cs.LG
TIER_1English(EN)·Pawe{\l} Skier\'s, Emilia Kaczmarczyk, Tomasz Trzci\'nski, Kamil Deja·
arXiv:2602.10216v2 Announce Type: replace Abstract: A single text prompt passed to a diffusion model yields a wide range of visual outputs determined solely by a stochastic process, leaving users with no direct control over which semantic variations appear. Exploring this range i…
arXiv:2606.22976v2 Announce Type: replace-cross Abstract: In this paper, we use random walks on graphs as a verifiable sandbox for studying parallel sampling strategies in masked diffusion models (MDMs). We train an MDM on random walk samples from a fixed graph. The graph and tra…
Online reinforcement learning (RL) fine-tunes diffusion models with black-box rewards, but reverse-process methods such as Flow-GRPO are limited in efficiency by poor credit assignment, while forward-process methods such as DiffusionNFT are efficient yet unstable without carefull…
Most image generation models rely on uniform tokenization, allocating the exact same computational budget to equally-sized image patches. This static paradigm cannot adapt to different resource constraints at inference time, and yields suboptimal quality-cost tradeoff by devoting…
arXiv:2610.07786v1 Announce Type: new Abstract: Pathwise gradients are preferred for continuous random variables because they are unbiased, low variance, and work with a single sample. For discrete variables, however, the pathwise identity cannot generally be exact for every diff…
arXiv:2610.07655v1 Announce Type: cross Abstract: Discrete diffusion models have emerged as a practically successful framework for generative modeling on discrete product spaces, yet their statistical generalization properties remain poorly understood. Discrete real-world data su…
arXiv cs.LG
TIER_1English(EN)·Christian Tantardini, Stig Rune Jensen, Roberto Di Remigio Eik{\aa}s, Joakim Henrik Beck·
arXiv:2610.07884v1 Announce Type: cross Abstract: Adaptive multiresolution methods reduce representation cost by concentrating fine-scale degrees of freedom where needed, but their tree updates are usually governed by fixed local criteria. We introduce Learned Adaptive Multiresol…
arXiv cs.LG
TIER_1English(EN)·Aavash Subedi, Tim Reichelt, Christopher Williams, Philip Stier, Yee Whye Teh, Saifuddin Syed·
arXiv:2610.08652v1 Announce Type: cross Abstract: Diffusion models are increasingly used as surrogates for expensive simulators in weather prediction, molecular dynamics, and materials design. In these models, computing the probability $p_0[E]$ of an event $E$ is difficult, espec…
arXiv cs.AI
TIER_1English(EN)·Haipeng Liu, Yang Wang, Meng Wang·
arXiv:2610.07684v1 Announce Type: cross Abstract: Personalized image generation aims to synthesize text-driven images conditioned on reference images, while mainly casting the generation as image customization for foreground and style transfer for background. Previous arts of dif…
arXiv cs.AI
TIER_1English(EN)·Richard Lee Kim, Yeongmin Kim, Gyuwon Sim, Taekyu Kim, Minsang Park, Il-chul Moon·
arXiv:2610.05108v2 Announce Type: replace-cross Abstract: Diffusion models achieve strong generative performance but often struggle to align generated samples with human preferences measured by a reward model. A simple yet effective algorithm for test-time alignment is Best-of-$N…
Recent work on language-model adaptation has shown that single models can obtain informative training signals by evaluating their behavior in demonstrationor feedback-augmented contexts, with the help of a teacher network, which is driven by the student's learned parameters. Insp…
Pixel-space diffusion models avoid the lossy VAE of latent models, which suggests an advantage on downstream tasks where fine-grained detail matters. We test this claim along both routes to a pixel-space backbone. We pretrain Iris-3B, a 3B-parameter pixel-space text-to-image tran…
Neural simulation of high-fidelity deformable bodies is a foundational challenge in computer graphics and physical AI. Long-horizon prediction for high-resolution 3D volumetric meshes is difficult: autoregressive methods are susceptible to error accumulation, while direct multi-f…
arXiv:2610.03034v1 Announce Type: cross Abstract: Diffusion models rely on numerical solvers requiring time-discretization, which has a large influence on the tradeoff between sampling cost and quality. However, the computational difficulty of the reverse process varies along the…
arXiv cs.LG
TIER_1English(EN)·Ziwen Liu, Yan Liu, Congying Han, Tiande Guo, Yao Yan, Weichen Zhao·
arXiv:2610.03071v1 Announce Type: new Abstract: Chance-constrained programs (CCPs) optimize decisions under uncertainty by limiting the probability of constraint violation. Despite advances in traditional and learning-based approaches, optimizing non-convex or non-smooth objectiv…
arXiv cs.AI
TIER_1English(EN)·Shuo Yang, Lihao Fang, Yi Zhang, Haixiang Wang, Xincheng Ye, Shufan Chen, Jipeng Guo, Youqing Wang·
arXiv:2610.03577v1 Announce Type: cross Abstract: Diffusion Transformers (DiTs) can generate high-quality images and videos, but generating each sample requires multiple costly DiT forward passes. Two common ways to accelerate DiT sampling are step distillation, which reduces the…
arXiv:2610.03503v1 Announce Type: new Abstract: Training-free posterior sampling methods, also known as Plug-and-Play methods, leverage pretrained unconditional diffusion or flow-matching models to solve inverse problems. Most existing approaches rely on guidance weights to balan…
arXiv cs.LG
TIER_1English(EN)·Vladislav Gromadskii, David Li, Samson Gourevitch, Yazid Janati, Eric Moulines, Maxim Panov, Alexander Korotin·
arXiv:2610.03641v1 Announce Type: new Abstract: Masked discrete diffusion models offer a promising alternative to autoregressive generation, but iterative sampling can be costly, and intractable sequence likelihoods complicate reward fine-tuning. We introduce IDRF, a framework fo…
Sparse attention is a primary approach to reducing the latency of diffusion transformers in long-sequence generation tasks, such as video and high-resolution 3D asset generation. However, existing methods can degrade generation quality and fidelity at high sparsity levels. Throug…
arXiv cs.LG
TIER_1English(EN)·Michael Y. Fatemi, Jinhao Liang, Ferdinando Fioretto·
arXiv:2610.01959v1 Announce Type: cross Abstract: Path finding and multi-robot motion planning require trajectories that are smooth, goal-directed, and collision-free in environments with complex geometric constraints. Recent diffusion-based planners have shown that trajectory ge…
arXiv cs.LG
TIER_1English(EN)·Aneesh Barthakur, Mathias Niepert, Luiz F. O. Chamon·
arXiv:2610.01502v1 Announce Type: new Abstract: Diffusion models are a powerful generative paradigm used across multimedia and scientific applications. Guided diffusion methods impose requirements on the generation by adding the gradient of a differentiable loss (the guidance fun…
Diffusion models rely on numerical solvers requiring time-discretization, which has a large influence on the tradeoff between sampling cost and quality. However, the computational difficulty of the reverse process varies along the sampling trajectory and across data distributions…
arXiv:2610.01789v1 Announce Type: cross Abstract: Reinforcement learning based post training of diffusion models, such as Denoising Diffusion Policy Optimization (DDPO), optimizes a reverse diffusion process under a reward function. However, current approaches to reward optimizat…
Reinforcement learning based post training of diffusion models, such as Denoising Diffusion Policy Optimization (DDPO), optimizes a reverse diffusion process under a reward function. However, current approaches to reward optimizations do so at the cost of diversity and quality. I…
arXiv cs.AI
TIER_1English(EN)·Junhyun Ha, Juho Lee, Byungwoo Park·
arXiv:2609.36812v1 Announce Type: cross Abstract: Diffusion and flow policies can model complex behaviors in offline reinforcement learning (RL). However, penalizing their KL divergence from the behavior policy can discourage actions having high critic values with low behavior de…
arXiv cs.LG
TIER_1English(EN)·Yinuo Ren, Haoxuan Chen, Grant M. Rotskoff, Jiequn Han, Lexing Ying·
arXiv:2609.35947v1 Announce Type: new Abstract: Many inference-time tasks for pretrained discrete diffusion models and diffusion language models reduce to drawing samples from a tilted version of the pretrained distribution. Feynman-Kac sequential Monte Carlo (SMC) makes this cor…
Diffusion and flow policies can model complex behaviors in offline reinforcement learning (RL). However, penalizing their KL divergence from the behavior policy can discourage actions having high critic values with low behavior density. Directly refining behavior proposals may be…
arXiv:2610.22975v1 Announce Type: new Abstract: Diffusion Transformers (DiTs) have become a common backbone for high-quality text-to-image and text-to-video generation, but repeated dense self-attention remains a major inference bottleneck as token sequences grow and the same ope…
arXiv:2610.22369v1 Announce Type: new Abstract: Diffusion and flow models generate a sample over iterative steps, each a full pass through a large network, and that pass dominates generation cost. Training-free caching accelerates them by reusing activations from recent evaluatio…
arXiv cs.CV
TIER_1English(EN)·SeungJu Cha, Ye-Chan Kim, HyunGee Kim, Sungho Koh, Dong-Jin Kim·
arXiv:2610.22370v1 Announce Type: new Abstract: Token merging has emerged as an effective training-free strategy for accelerating diffusion models by reducing redundant token computation while minimizing generation degradation. A key challenge is determining which tokens can be s…
arXiv cs.CV
TIER_1English(EN)·Mang Ning, Mingxiao Li, Le Zhang, Lanmiao Liu, Matthew B. Blaschko, Albert Ali Salah, Itir Onal Ertugrul·
arXiv:2603.14645v2 Announce Type: replace Abstract: In this paper, we study the diffusability (learnability) of variational autoencoders (VAEs) in latent diffusion. We first derive distribution-free bounds on the maximum achievable reduction in pixel-space denoising loss. Under a…
arXiv cs.CV
TIER_1English(EN)·Donghwan Lee, Sanghyun Jo, Sihyun Kim, Ziseok Lee, Kyungsu Kim·
arXiv:2610.21287v1 Announce Type: new Abstract: Training-free object removal commonly redirects self-attention away from the target region, but on few-step distilled diffusion models this often leaves object-shaped residuals. We identify a temporal mismatch: a structured predicti…
arXiv cs.CV
TIER_1English(EN)·Zhuobai Dong, Junchao Yi, Hu Jian Guo, Linjie Li, Rui Zhao, Alex Jinpeng Wang·
arXiv:2610.20220v1 Announce Type: new Abstract: Autoregressive generation underlies real-time, causal video synthesis and is the backbone of video world models. Today's dominant approach distills a bidirectional diffusion model into a causal few-step student, but existing pipelin…
arXiv:2610.17579v1 Announce Type: new Abstract: Inference-time alignment steers diffusion models toward downstream objectives without costly fine-tuning, but existing methods typically optimize expected cost (or reward) without explicitly controlling tail risk. In this work, we p…
arXiv stat.ML
TIER_1English(EN)·Hamza Cherkaoui, H\'el\`ene Halconruy, Antonio Ocello·
arXiv:2610.16851v1 Announce Type: cross Abstract: Diffusion and flow-matching models may struggle to accurately represent distributional tails, especially for heavy-tailed data. Existing approaches often use heavy-tailed noise or modify the generative dynamics, requiring dedicate…
arXiv:2610.14133v1 Announce Type: new Abstract: Generative modelling involves two complementary tasks: learning a probabilistic approximation of an unknown data distribution from observations, and designing a tractable mechanism for sampling from this approximation. We present a …
arXiv:2610.12952v1 Announce Type: cross Abstract: Image watermarking enables provenance tracing for photorealistic images generated by diffusion models. However, state-of-the-art (SOTA) removal attacks can suppress embedded signals with little perceptual degradation. This vulnera…
arXiv:2610.13851v1 Announce Type: new Abstract: We establish finite-sample guarantees for conditional diffusion models learned from data and implemented with finitely many denoising steps. Our approach aligns the score-training objective with the sampling grid, allowing statistic…
arXiv:2610.12544v1 Announce Type: cross Abstract: Masked diffusion models (MDMs) generate discrete data by iteratively unmasking multiple tokens in parallel using a learned mask predictor. Their output carries two errors: parallelization error due to parallel sampling, and estima…
arXiv stat.ML
TIER_1English(EN)·Andrew Zammit-Mangion, Lachlan Astfalck, Rapha\"el Huser, Christopher Nemeth, Henry B. Moss·
arXiv:2610.12967v1 Announce Type: cross Abstract: Spatial prediction is a critically important task in data analyses that involve spatially or spatio-temporally-referenced data. It is commonly carried out using hierarchical models, which comprise a process model describing the la…
arXiv:2610.12625v1 Announce Type: new Abstract: Autoregressive video diffusion models have become a leading approach to real-time interactive video generation and video world modeling. However, existing methods typically allocate computation uniformly across space when generating…
arXiv stat.ML
TIER_1English(EN)·Khaled Kahouli, Winfried Ripken, Stefan Gugler, Oliver T. Unke, Klaus-Robert M\"{u}ller, Shinichi Nakajima·
arXiv:2502.08598v3 Announce Type: replace-cross Abstract: Diffusion models have been widely adopted as a powerful generative framework across numerous scientific domains, yet their inherently iterative sampling process remains a significant computational bottleneck. While this is…
arXiv:2610.12978v1 Announce Type: new Abstract: Visual representations are largely developed for understanding, yet what makes them useful for generation remains unclear. We study this question in pixel diffusion transformers and uncover two key insights. First, better representa…
arXiv cs.CV
TIER_1English(EN)·Haoqian Zhang, Ziyuan Yang, Zerui Shao, Yi Zhang·
arXiv:2610.11238v1 Announce Type: new Abstract: Diffusion models have achieved remarkable success in image generation, yet tracing their outputs to individual training examples remains challenging. Existing attribution methods often compress factor-specific effects into scalar re…
arXiv:2610.09077v1 Announce Type: new Abstract: Diffusion-based image super-resolution (SR) can create visually plausible detail that is not supported by the low-resolution input. We introduce DISRQAD, a subjective-quality dataset and diagnostic benchmark for this setting. It con…
arXiv cs.CV
TIER_1English(EN)·Hanqiu Li Cai (SperidLabs), Chema Garabito (SperidLabs)·
arXiv:2610.09450v1 Announce Type: new Abstract: Pixel-space diffusion models avoid the lossy VAE of latent models, which suggests an advantage on downstream tasks where fine-grained detail matters. We test this claim along both routes to a pixel-space backbone. We pretrain Iris-3…
arXiv:2610.09376v1 Announce Type: new Abstract: Acquiring a complete set of magnetic resonance imaging (MRI) contrasts is time-intensive and uncomfortable for patients, despite the diagnostic value of multi-contrast imaging. This motivates synthesizing missing contrasts from thos…
arXiv:2610.09242v1 Announce Type: new Abstract: Representation Autoencoders (RAEs) generate images from pre-trained visual fea- tures, but their dense token grids make generative modeling expensive. Motivated by local feature correlations, we introduce PoolDINO, a learned affine …
arXiv:2610.07609v1 Announce Type: new Abstract: Neural simulation of high-fidelity deformable bodies is a foundational challenge in computer graphics and physical AI. Long-horizon prediction for high-resolution 3D volumetric meshes is hard: autoregressive methods are susceptible …
arXiv:2609.39091v1 Announce Type: new Abstract: Inference-time alignment of flow and diffusion-based models is critical for achieving flexible generative modeling. Theoretically, Doob's $h$-transform provides an elegant solution to this problem, and most existing methods are base…
<table> <tr><td> <a href="https://www.reddit.com/r/MachineLearning/comments/1x49d61/looped_diffusion_transformer_the_same_blocks_run/"> <img alt="Looped Diffusion Transformer: the same blocks run several times inside each denoising step, and loop depth can be changed at sampling …
DiffusionART, a new paper on reinforcing diffusion models for efficiency, stability and scalability, has 228 upvotes on Hugging Face. https:// huggingface.co/papers/2610.125 72 # AI # MachineLearning # Research
<!-- SC_OFF --><div class="md"><p>At the moment only the flux1-krea-dev code has been release. Qwen-Image, Ideogram 4, and Flux2 "coming soon".</p> <p>Project: <a href="https://rajabi2001.github.io/area/">https://rajabi2001.github.io/area/</a></p> <p>Paper: <a href="htt…