English(EN) HarmoniDPO: Video-guided Audio Generation via Preference-Optimized Diffusion

新研究通过增强的控制力和质量推进视频到音频生成

作者 PulseAugur 编辑部 · [2 个来源] · 2026-08-13 04:00

两篇新研究论文介绍了视频到音频（V2A）生成的先进方法。ControlFoley 专注于通过更有效地整合视觉和文本信息以及解耦音频的时间和音色方面来增强可控性。HarmoniDPO 通过使用双视频表示和偏好优化（类似于人类反馈强化学习）来解决同步和质量问题，使生成的音频与人类感知保持一致。 AI

影响视频到音频生成的这些进步可能带来更复杂的多媒体内容创建和分析工具。

排序理由两篇在 arXiv 上发表的学术论文，详细介绍了视频到音频生成的新方法。

AI 生成摘要 · Google Gemini · 来自 2 个来源。我们如何撰写摘要 →

本文如何被排名

Signal score: 0 / 100; Composite score across the factors below. Higher = stronger signal that this story matters right now.
Newsworthiness bucket: Research; 两篇在 arXiv 上发表的学术论文，详细介绍了视频到音频生成的新方法。
Source corroboration: 2 independent sources; Multiple independent publishers reporting the same story raises confidence that it's real and newsworthy.
Topics: paper, model release; Editorial topic classification. Feeds into how the story surfaces on /topic/<slug> hub pages and into the per-entity coverage mix.
AI-industry relevance: High; Clearly on-topic for AI-industry coverage.
Story freshness: 60 days old; Aged out of breaking-news scoring windows; ranking reflects the durable signal from the full source set.

完整方法见我们的编辑标准。

arXiv cs.CV TIER_1 English(EN) · Jianxuan Yang, Xinyue Guo, Zhi Cheng, Kai Wang, Lipan Zhang, Jinjie Hu, Qiang Ji, Yihua Cao, Yihao Meng, Zhaoyue Cui, Mengmei Liu, Meng Meng, Jian Luan · 2026-08-14 04:00

ControlFoley：统一且可控的视频到音频生成，并进行跨模态冲突处理

arXiv:2604.15086v2 Announce Type: replace-cross Abstract: Recent advances in video-to-audio (V2A) generation enable high-quality audio synthesis from visual content, yet achieving robust and fine-grained controllability remains challenging. Existing methods suffer from weak textu…
arXiv cs.CV TIER_1 English(EN) · Wenshuo Peng, Kaipeng Zhang · 2026-08-13 04:00

HarmoniDPO：通过偏好优化扩散实现视频引导的音频生成

arXiv:2608.11913v1 Announce Type: new Abstract: Video-to-audio (V2A) generation faces significant challenges in achieving precise temporal synchronization and high perceptual quality due to the complex, ambiguous relationship between visual and auditory cues. Existing methods typ…