IMAGINE: Adaptive Schema-Imagery Enhanced Composition for Composed Video Retrieval
Researchers have developed IMAGINE, a novel network designed for Composed Video Retrieval (CVR) and Composed Image Retrieval (CIR). This system addresses the limitation of existing methods by incorporating implicit semantic information, which is often conveyed through visually related cues rather than explicit representations. IMAGINE utilizes dynamic multimodal prototypes to capture these shared latent concepts, adaptively modulating visual features to guide the retrieval process more effectively. The approach has demonstrated state-of-the-art performance on three major benchmarks for both CVR and CIR tasks. AI
IMPACT Enhances video and image retrieval by incorporating implicit semantic understanding, potentially improving search accuracy in multimodal AI systems.