PulseAugur
EN
LIVE 03:15:41

New DLGStream method enables interactive free-viewpoint video with language features

Researchers have developed DLGStream, a new method for creating interactive free-viewpoint videos (FVVs) by embedding language features into 3D Gaussian Splatting. This approach allows for open-vocabulary queries and scene editing, overcoming limitations of previous methods that struggled with the high frame rates and low frame sizes required for FVV. DLGStream utilizes a dual-opacity dynamic language Gaussian representation and an interpolation-based deformation field to optimize performance and reduce temporal redundancy, enabling high-quality FVV with an average frame size of just 43 KB. AI

IMPACT This development could enhance user interaction and editing capabilities in free-viewpoint video applications.

RANK_REASON The cluster describes a new method presented in an arXiv paper for video processing. [lever_c_demoted from research: ic=1 ai=1.0]

Read on arXiv cs.CV →

AI-generated summary · Google Gemini · from 1 sources. How we write summaries →

New DLGStream method enables interactive free-viewpoint video with language features

COVERAGE [1]

  1. arXiv cs.CV TIER_1 English(EN) · Zhihui Ke, Yuyang Liu, Xiaobo Zhou, Tie Qiu ·

    DLGStream: Dynamic Language-embedded Guassian Splatting for Open-vocabulary Enabled Free-viewpoint Video Streaming

    arXiv:2606.28840v1 Announce Type: new Abstract: 3D Gaussian Splatting~(3DGS) has emerged as a promising paradigm for reconstructing streamable free-viewpoint video~(FVV) from multi-view videos. However, 3DGS-based FVVs typically lack user interaction and editing capabilities, whi…