PulseAugur
EN
LIVE 06:36:48

New DrIG framework enhances multimodal generative retrieval

Researchers have introduced DrIG, a novel framework for universal multimodal retrieval that utilizes dual-role identifiers to enhance generative information retrieval. This approach addresses limitations in existing methods, such as prefix-level errors and the predominantly unimodal nature of current systems. DrIG supports diverse retrieval tasks across text, image, and mixed image-text data by assigning each candidate a single identifier that functions both sequentially for autoregressive decoding and as a set for prefix-independent relevance priors. Experiments on the M-BEIR benchmark and text-to-image datasets demonstrate that DrIG outperforms state-of-the-art generative multimodal baselines, offering a favorable efficiency-effectiveness trade-off. AI

IMPACT This framework could improve the efficiency and accuracy of information retrieval systems across various data types.

RANK_REASON The cluster contains a research paper detailing a new framework for generative multimodal retrieval. [lever_c_demoted from research: ic=1 ai=1.0]

Read on arXiv cs.IR (Information Retrieval) →

AI-generated summary · Google Gemini · from 1 sources. How we write summaries →

New DrIG framework enhances multimodal generative retrieval

COVERAGE [1]

  1. arXiv cs.IR (Information Retrieval) TIER_1 English(EN) · Xuanchen Zhou ·

    Generative Universal Multimodal Retrieval with Dual-role Identifiers

    Generative information retrieval (GIR) has emerged as a compelling alternative to the conventional index-retrieve-then-rank retrieval pipeline by training a generator to produce the identifiers of relevant items directly. Despite its promise, a number of open challenges still rem…