Researchers have introduced TV-AudioRemover, a novel framework designed to remove sounds associated with specific visual objects from videos. Unlike previous methods that relied on single-modal control, TV-AudioRemover utilizes both the visually edited video and natural-language instructions for more effective multimodal guidance. The project also includes the creation of a large-scale dataset for training, a comprehensive benchmark called AV-Remove-Bench for evaluation, and an MLLM-based assessment protocol. AI
IMPACT This research could lead to more sophisticated video editing tools by enabling precise audio manipulation synchronized with visual edits.
RANK_REASON This is a research paper describing a new method and dataset. [lever_c_demoted from research: ic=1 ai=1.0]
- alphaXiv
- arXiv
- AV-Remove-Bench
- CatalyzeX
- DagsHub
- Gotit.pub
- Hugging Face
- Jianxuan Yang
- multimodal large language model
- ScienceCast
- TV-AudioRemover
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →