Researchers have developed SPARSEUP, a new training methodology for learned sparse retrieval models that improves their efficiency and effectiveness. This approach addresses the challenges in training these models by optimizing logit distribution and introducing a per-position fan-out control. Additionally, a vocabulary merging strategy is employed to remove redundant entries, leading to a more streamlined encoder. When applied to the LateOn backbone, SPARSEUP achieved a state-of-the-art 56.4 average nDCG@10 on the BEIR-13 benchmark among sparse encoders under 150M parameters. AI
IMPACT Improves the efficiency and effectiveness of sparse retrieval models, potentially enhancing search and information retrieval systems.
RANK_REASON Research paper detailing a new training methodology for learned sparse retrieval models. [lever_c_demoted from research: ic=1 ai=1.0]
Read on arXiv cs.IR (Information Retrieval) →
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →