一篇新论文探讨了离散扩散模型的理论基础，提出了“Oracle Distance”定理。该定理将负证据下界（ELBO）等同于数据熵加上预言机和学习到的逆向过程之间的路径KL散度。该研究确定了优化器的三个精确坐标——去噪器、空腔和分数——并提供了它们之间的转换方法，统一了MDM和UDM等各种现有损失函数。 AI
影响 为理解和优化离散扩散模型提供了一个统一的理论框架。
排序理由 该集群包含一篇在arXiv上发表的学术论文，详细介绍了机器学习领域的理论研究。
AI 生成摘要 · Google Gemini · 来自 2 个来源。 我们如何撰写摘要 →
arXiv:2607.05381v1 Announce Type: cross Abstract: What does a discrete diffusion model learn: a denoiser, a score ratio, or a bridge plug-in predictor? At the level of jump rates, these are one object in different coordinates, and reading a neural network in the wrong coordinate …
What does a discrete diffusion model learn: a denoiser, a score ratio, or a bridge plug-in predictor? At the level of jump rates, these are one object in different coordinates, and reading a neural network in the wrong coordinate changes the process being trained and sampled. Sta…