PulseAugur
实时 21:06:55
English(EN) Sparkle: Realizing Lively Instruction-Guided Video Background Replacement via Decoupled Guidance

Sparkle 数据集和基准推动 AI 视频背景替换技术发展

研究人员推出了 Sparkle,这是一个旨在改进指令引导视频背景替换的新数据集和基准。该数据集包含约 140,000 对视频,涵盖五个主题,解决了高质量训练数据稀缺的问题,而这种稀缺性曾阻碍了 Kiwi-Edit 等先前模型的发展。Sparkle 采用新颖的解耦前景和背景引导合成流程,实现了更自然、时间上更一致的场景切换。实验表明,在 Sparkle 上训练的模型在新的 Sparkle-BenchOpenVE-Bench 上均优于现有基线。 AI

影响 增强了视频编辑工具的功能,有望改善电影和广告内容创作。

排序理由 这是一篇介绍用于视频背景替换的新数据集和基准的研究论文。

在 arXiv cs.CV 阅读 →

AI 生成摘要 · Google Gemini · 来自 2 个来源。 我们如何撰写摘要 →

Sparkle 数据集和基准推动 AI 视频背景替换技术发展

报道来源 [2]

  1. arXiv cs.CV TIER_1 English(EN) · Ziyun Zeng, Yiqi Lin, Guoqiang Liang, Mike Zheng Shou ·

    Sparkle: Realizing Lively Instruction-Guided Video Background Replacement via Decoupled Guidance

    arXiv:2605.06535v1 Announce Type: new Abstract: In recent years, open-source efforts like Senorita-2M have propelled video editing toward natural language instruction. However, current publicly available datasets predominantly focus on local editing or style transfer, which large…

  2. arXiv cs.CV TIER_1 English(EN) · Mike Zheng Shou ·

    Sparkle: Realizing Lively Instruction-Guided Video Background Replacement via Decoupled Guidance

    In recent years, open-source efforts like Senorita-2M have propelled video editing toward natural language instruction. However, current publicly available datasets predominantly focus on local editing or style transfer, which largely preserve the original scene structure and are…