PulseAugur
实时 13:37:21

新研究推动扩散模型在量化、运动生成和RLHF方面的进展

研究人员开发了改进扩散模型的新方法。其中一篇论文介绍了引导感知混合精度(GAMP),以解决无分类器引导(CFG)扩散模型中的量化挑战,防止无条件分支漂移。另一篇论文提出了ARDY,一个用于文本和运动学控制的实时、高保真3D人体运动生成的框架。此外,还提出了一种名为ContrastiveCFG的新方法,通过使用对比损失来增强条件扩散模型的采样,以实现更好的概念对齐和过滤。最后,详细介绍了样本高效扩散RLHF的进展,其特点是选择性时间步加权和基于优势的回放,以提高反馈效率。 AI

影响 这些进展可能带来更高效、更强大的扩散模型,应用于从内容生成到机器人技术的各种领域。

排序理由 多篇arXiv上发表的研究论文,详细介绍了扩散模型、量化、运动生成和RLHF方面的进展。

在 arXiv cs.IR (Information Retrieval) 阅读 →

AI 生成摘要 · Google Gemini · 来自 33 个来源。 我们如何撰写摘要 →

新研究推动扩散模型在量化、运动生成和RLHF方面的进展

报道来源 [33]

  1. arXiv cs.LG TIER_1 English(EN) · Kaifeng Zhao, Mathis Petrovich, Haotian Zhang, Tingwu Wang, Siyu Tang, Davis Rempe ·

    ARDY: Autoregressive Diffusion with Hybrid Representation for Interactive Human Motion Generation

    arXiv:2607.08741v1 Announce Type: cross Abstract: Generating realistic 3D human motions in real-time within interactive applications is key for animation, simulation, and humanoid robotics. While recent offline motion generation approaches offer precise control via text and kinem…

  2. arXiv cs.LG TIER_1 English(EN) · Abdullah Al Shafi, Sumaiya Rahim Suma ·

    Closing the Null Space: Guidance-Aware Quantization for Classifier-Free Diffusion

    arXiv:2607.08241v1 Announce Type: cross Abstract: Deploying classifier-free guidance (CFG) diffusion models under real-world compute budgets requires quantization, yet existing post-training quantization (PTQ) methods treat CFG models as single-branch networks, ignoring the paire…

  3. arXiv cs.LG TIER_1 English(EN) · Davis Rempe ·

    ARDY: Autoregressive Diffusion with Hybrid Representation for Interactive Human Motion Generation

    Generating realistic 3D human motions in real-time within interactive applications is key for animation, simulation, and humanoid robotics. While recent offline motion generation approaches offer precise control via text and kinematic constraints, they lack the inference speed re…

  4. Hugging Face Daily Papers TIER_1 English(EN) ·

    AutoAnchor: Stable Diffusion Unlearning Using Cross-Attention as a Manifold Surrogate

    Diffusion unlearning is essential for mitigating the generation of harmful or copyrighted content in text-to-image models. Current diffusion unlearning techniques determine the model update direction by either using alternatives of the target concept as an anchor or using empty p…

  5. arXiv cs.LG TIER_1 English(EN) · Sumaiya Rahim Suma ·

    Closing the Null Space: Guidance-Aware Quantization for Classifier-Free Diffusion

    Deploying classifier-free guidance (CFG) diffusion models under real-world compute budgets requires quantization, yet existing post-training quantization (PTQ) methods treat CFG models as single-branch networks, ignoring the paired conditional/unconditional structure that CFG inf…

  6. arXiv cs.AI TIER_1 English(EN) · Zhiheng Zhou, Mengyao Zhou, Dengyi Zhao, Xingqin Qi, Guiying Yan ·

    Hypergraph Neural Stochastic Diffusion: An SDE Framework for Uncertainty Estimation

    arXiv:2607.07330v1 Announce Type: cross Abstract: Hypergraph neural networks have shown powerful capability in modeling higher-order relations, yet their predictive uncertainty remains underexplored. Unlike pairwise graphs, uncertainty in hypergraphs arises not only from noisy at…

  7. arXiv cs.AI TIER_1 English(EN) · Eric Zhu, Abhinav Shrivastava, Soumik Mukhopadhyay ·

    选择性时间步加权与基于优势的重放以实现样本高效的扩散式强化学习人类反馈

    arXiv:2607.07693v1 Announce Type: cross Abstract: Reinforcement learning from human feedback (RLHF) has emerged as a powerful paradigm for aligning generative models with human preferences. However, applying RLHF to diffusion models remains highly feedback inefficient, as existin…

  8. arXiv cs.AI TIER_1 English(EN) · Jinho Chang, Changsun Lee, Hyungjin Chung, Jong Chul Ye ·

    ContrastiveCFG: 通过对比正负概念引导扩散采样

    arXiv:2411.17077v2 Announce Type: replace-cross Abstract: As Classifier-Free Guidance (CFG) has proven effective in conditional diffusion model sampling for improved condition alignment, many applications use a negated CFG term as a Negative Prompting (NP) to filter out unwanted …

  9. arXiv cs.LG TIER_1 English(EN) · Yi\u{g}it Berkay Uslu, Samar Hadou, Sergio Rozada, Shirin Saeedi Bidokhti, Alejandro Ribeiro ·

    随机图信号的生成式扩散模型

    arXiv:2607.06833v1 Announce Type: new Abstract: Sampling stochastic signals supported on a graph underlies many graph machine learning tasks, including recommender systems, forecasting in financial markets, and wireless network optimization. In these settings, the target signals …

  10. Hugging Face Daily Papers TIER_1 English(EN) ·

    ARDY: Autoregressive Diffusion with Hybrid Representation for Interactive Human Motion Generation

    ARDY is a streaming generation framework that enables real-time, high-fidelity 3D human motion generation with text and kinematic constraint control through a hybrid representation and two-stage autoregressive transformer denoiser.

  11. arXiv cs.AI TIER_1 English(EN) · Soumik Mukhopadhyay ·

    选择性时间步加权和基于优势的回放以实现样本高效的扩散式强化学习人类反馈

    Reinforcement learning from human feedback (RLHF) has emerged as a powerful paradigm for aligning generative models with human preferences. However, applying RLHF to diffusion models remains highly feedback inefficient, as existing approaches typically require large amounts of hu…

  12. arXiv cs.AI TIER_1 English(EN) · Guiying Yan ·

    Hypergraph Neural Stochastic Diffusion: An SDE Framework for Uncertainty Estimation

    Hypergraph neural networks have shown powerful capability in modeling higher-order relations, yet their predictive uncertainty remains underexplored. Unlike pairwise graphs, uncertainty in hypergraphs arises not only from noisy attributes and ambiguous labels, but also from varia…

  13. arXiv cs.LG TIER_1 English(EN) · Bowen Xue, Zihan Min, Xingyang Li, Zhekai Zhang, Haocheng Xi, Lvmin Zhang, Maneesh Agrawala, Jun-Yan Zhu, Song Han, Yujun Lin, Muyang Li ·

    FourTune:迈向扩散模型全4位高效训练后优化

    arXiv:2607.05711v1 Announce Type: new Abstract: Diffusion models have become a dominant paradigm for high-quality generative modeling, while post-training is essential for adapting them to diverse downstream applications. However, post-training of large diffusion models is still …

  14. arXiv cs.AI TIER_1 English(EN) · Wenhao Wang, Yifan Sun, Zongxin Yang, Zhengdong Hu, Zhentao Tan, Yi Yang ·

    视觉扩散模型中的复制:调查与展望

    arXiv:2408.00001v2 Announce Type: replace-cross Abstract: Visual diffusion models have revolutionized the field of creative AI, producing high-quality and diverse content. However, they inevitably memorize training images or videos, subsequently replicating their concepts, conten…

  15. arXiv cs.LG TIER_1 English(EN) · Amandeep Kumar, Vishal M. Patel ·

    流形上的学习:用表示编码器解锁标准扩散 Transformer

    arXiv:2602.10099v2 Announce Type: replace Abstract: Leveraging representation encoders for generative modeling offers a path for efficient, high-fidelity synthesis. However, standard diffusion transformers fail to converge on these representations directly. While recent work attr…

  16. arXiv cs.AI TIER_1 English(EN) · Rajat Rasal, Avinash Kori, Tian Xia, Ben Glocker ·

    在扩散表示学习中引导优化轨迹

    arXiv:2607.05319v1 Announce Type: cross Abstract: We study why diffusion autoencoders can achieve similar image quality while learning substantially different latent structures. We trace this behaviour to optimisation dynamics; we analyse curves of image reconstruction against la…

  17. arXiv cs.LG TIER_1 English(EN) · Muyang Li ·

    FourTune:迈向扩散模型完全4位高效的训练后优化

    Diffusion models have become a dominant paradigm for high-quality generative modeling, while post-training is essential for adapting them to diverse downstream applications. However, post-training of large diffusion models is still challenging due to the prohibitive memory footpr…

  18. arXiv cs.AI TIER_1 English(EN) · Ben Glocker ·

    扩散表示学习中的优化轨迹引导

    We study why diffusion autoencoders can achieve similar image quality while learning substantially different latent structures. We trace this behaviour to optimisation dynamics; we analyse curves of image reconstruction against latent representation quality, revealing trajectorie…

  19. arXiv cs.IR (Information Retrieval) TIER_1 English(EN) · Xi Liu ·

    Diffusion-GR2:Diffusion生成式推理重排器

    Generative reasoning re-rankers achieve strong recommendation accuracy by emitting a chain-of-thought before re-ordering a candidate list, but they are slow at inference: an autoregressive (AR) decoder spends one sequential forward pass per reasoning token, and the reasoning trac…

  20. arXiv cs.IR (Information Retrieval) TIER_1 English(EN) · Xi Liu ·

    Diffusion-GR2: Diffusion 生成式推理重排器

    Generative reasoning re-rankers achieve strong recommendation accuracy by emitting a chain-of-thought before re-ordering a candidate list, but they are slow at inference: an autoregressive (AR) decoder spends one sequential forward pass per reasoning token, and the reasoning trac…

  21. arXiv cs.CV TIER_1 English(EN) · Cheng Wan, Bahram Jafrasteh, Ehsan Adeli, Miaomiao Zhang, Qingyu Zhao ·

    Anatomically Guided Latent Diffusion for Brain MRI Progression Modeling

    arXiv:2601.14584v2 Announce Type: replace Abstract: Accurately modeling longitudinal brain MRI progression is crucial for understanding neurodegenerative diseases and predicting individualized structural changes. Existing state-of-the-art approaches, such as Brain Latent Progress…

  22. arXiv stat.ML TIER_1 English(EN) · Yidong Ouyang, Zhe Wang, Sourav Bhabesh, Dmitriy Bespalov ·

    Reinforcing the Generation Order of Multimodal Masked Diffusion Models

    arXiv:2607.08056v1 Announce Type: cross Abstract: Diffusion Language Models (DLMs) have recently achieved substantial progress in natural language generation tasks. Recent research demonstrates that adaptive token generation ordering can significantly improve performance in mathe…

  23. arXiv stat.ML TIER_1 English(EN) · Siyuan Wen, Jiahao Zeng, Ningning Ding ·

    AutoAnchor: Stable Diffusion Unlearning Using Cross-Attention as a Manifold Surrogate

    arXiv:2607.08337v1 Announce Type: cross Abstract: Diffusion unlearning is essential for mitigating the generation of harmful or copyrighted content in text-to-image models. Current diffusion unlearning techniques determine the model update direction by either using alternatives o…

  24. arXiv stat.ML TIER_1 English(EN) · Ningning Ding ·

    AutoAnchor: Stable Diffusion Unlearning Using Cross-Attention as a Manifold Surrogate

    Diffusion unlearning is essential for mitigating the generation of harmful or copyrighted content in text-to-image models. Current diffusion unlearning techniques determine the model update direction by either using alternatives of the target concept as an anchor or using empty p…

  25. arXiv stat.ML TIER_1 English(EN) · Robert Gruhlke, Julius Berner, David Sommer, Lorenz Richter ·

    Tensor Train Diffusion:利用低秩结构进行高维基于分数的采样

    arXiv:2607.06841v1 Announce Type: new Abstract: Diffusion models offer a powerful framework for sampling from complex probability densities by learning to reverse a noising process. A common approach involves solving for the time-reversed stochastic differential equation (SDE), w…

  26. arXiv stat.ML TIER_1 English(EN) · Dmitriy Bespalov ·

    Reinforcing the Generation Order of Multimodal Masked Diffusion Models

    Diffusion Language Models (DLMs) have recently achieved substantial progress in natural language generation tasks. Recent research demonstrates that adaptive token generation ordering can significantly improve performance in mathematical reasoning and code synthesis applications.…

  27. arXiv cs.CV TIER_1 English(EN) · Wanglong Lu, Lingming Su, Kaijie Shi, Minglun Gong, Xiaogang Jin, Hanli Zhao, Xianta Jiang ·

    用于超高分辨率图像编辑的无微调潜在扩散模型

    arXiv:2607.06136v1 Announce Type: new Abstract: Recent diffusion-based generative models have shown impressive performance in image generation and editing. However, due to memory limitations and the high cost of collecting high-resolution training images, existing methods are typ…

  28. arXiv stat.ML TIER_1 English(EN) · Lorenz Richter ·

    Tensor Train Diffusion:利用低秩结构进行高维基于分数的采样

    Diffusion models offer a powerful framework for sampling from complex probability densities by learning to reverse a noising process. A common approach involves solving for the time-reversed stochastic differential equation (SDE), which requires the score function of the evolving…

  29. arXiv cs.CV TIER_1 English(EN) · Xianta Jiang ·

    用于超高分辨率图像编辑的无微调潜在扩散模型

    Recent diffusion-based generative models have shown impressive performance in image generation and editing. However, due to memory limitations and the high cost of collecting high-resolution training images, existing methods are typically restricted to inputs with linear resoluti…

  30. arXiv cs.CV TIER_1 English(EN) · Chunnan Shang, Xin Zhang, Zhizhong Wang, Hongwei Wang ·

    DICT:用于扩散模型条件图像生成的注入和对比轨迹细化数据

    arXiv:2607.03899v1 Announce Type: new Abstract: Diffusion models have become a dominant paradigm for conditional image generation, yet existing approaches generally follow two directions: task-specific designs that can improve performance but limit generalization, and training-fr…

  31. arXiv cs.CV TIER_1 English(EN) · Lijiang Li, Zuwei Long, Yunhang Shen, Heting Gao, Haoyu Cao, Xing Sun, Caifeng Shan, Ran He, Chaoyou Fu ·

    Omni-Diffusion:基于掩码离散扩散的统一多模态理解与生成

    arXiv:2603.06577v2 Announce Type: replace Abstract: While recent multimodal large language models (MLLMs) have made impressive strides, they predominantly employ a conventional autoregressive architecture as their backbone, leaving significant room to explore effective and effici…

  32. arXiv cs.CV TIER_1 English(EN) · Aryan Das, Koushik Biswas, Moloud Abdar, Vinay Kumar Verma ·

    UNITY:用于扩散模型自适应条件化的注意力流网络

    arXiv:2606.20971v2 Announce Type: replace Abstract: We introduce UNITY, a Universal-to-Specialized adapter for efficient and scalable composite conditioning in diffusion based image generation. Unlike prior methods that train separate adapters for each conditioning modality, UNIT…

  33. r/MachineLearning TIER_1 English(EN) · /u/Savings-Display5123 ·

    LingBot-Video:稀疏MoE视频扩散Transformer(总计13B,活跃1.4B)作为动作条件世界模型进行后训练[R]

    <!-- SC_OFF --><div class="md"><p>Single-stream diffusion transformer with a DeepSeek-V3-style sparse MoE (128 experts, top-8 routing, 1.4B active of 13B total). Six-reward RL post-training including a physical-plausibility reward, plus an action-to-video mode that predicts robot…