PulseAugur
EN
LIVE 07:59:57

QueenVIS framework enhances video instance segmentation without video training

Researchers have introduced QueenVIS, a novel framework designed to improve video instance segmentation (VIS) by focusing on the quality of object queries during single-frame training. This approach challenges the conventional reliance on video-level supervision and costly identity-consistent annotations. QueenVIS enhances object queries with auxiliary heads for feature and center prediction, which are then discarded during inference, adding no computational overhead. The framework utilizes a training-free method for query propagation and a memory bank to maintain temporal identity, achieving significant performance gains on benchmarks like YouTube-VIS and OVIS. AI

IMPACT This research offers a more efficient approach to video instance segmentation by reducing reliance on video-level training data, potentially lowering computational costs and annotation requirements.

RANK_REASON The item is a research paper detailing a new method for video instance segmentation. [lever_c_demoted from research: ic=1 ai=1.0]

Read on arXiv cs.CV →

AI-generated summary · Google Gemini · from 1 sources. How we write summaries →

QueenVIS framework enhances video instance segmentation without video training

COVERAGE [1]

  1. arXiv cs.CV TIER_1 English(EN) · Arian Kheirandish, Fardin Ayar, Ehsan Javanmardi, Manabu Tsukada, Mahdi Javanmardi ·

    QueenVIS: Rethinking Image-Only Training for Video Instance Segmentation via Query Enrichment

    arXiv:2607.24598v1 Announce Type: new Abstract: Video instance segmentation (VIS) requires models to detect, segment, and track object identities across frames, and most methods enforce temporal consistency through video-level supervision. Image-only training approaches, with Min…