Researchers have developed StreamErase, a novel system designed for ultra-fast streaming video object removal. This approach enables sub-second latency, achieving up to 26 frames per second on a single GPU by progressively transferring erasing capabilities from a powerful bidirectional model to an efficient unidirectional streaming eraser. StreamErase addresses challenges such as domain gap extrapolation, error accumulation, and maintaining fast inference over long video horizons through techniques like sliding-window causal attention with attention sinks and self-rollout. The system also introduces LongErase, a new benchmark specifically for streaming long-video object removal, and delivers real-time, interactive erasing results. AI
IMPACT Enables real-time, interactive video editing and content manipulation, potentially impacting post-production workflows and AR/VR applications.
RANK_REASON The item describes a new research paper and methodology for video processing. [lever_c_demoted from research: ic=1 ai=1.0]
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →