A new arXiv paper identifies a "search-by-answer bias" in dense retrieval models, where they favor passages containing known answer objects over those supporting alternative or even incorrect answers. This bias was observed across eight different retrieval models, including DPR, Contriever, and Qwen3-Embedding. The study found that models consistently ranked passages higher when they mentioned a familiar object, even if the relation expressed was inaccurate, indicating a significant flaw in how these models select evidence. AI
IMPACT Highlights a critical flaw in evidence selection for retrieval models, potentially impacting search accuracy and information retrieval systems.
RANK_REASON Research paper published on arXiv detailing a specific bias in retrieval models. [lever_c_demoted from research: ic=1 ai=1.0]
Read on arXiv cs.IR (Information Retrieval) →
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →