RAG rewriting gains driven by answer presence, not curation

Researchers have investigated the gains seen in retrieval-augmented question-answering (RAG) pipelines, specifically focusing on the role of a "rewriter" LLM. Their findings suggest that the observed improvements in F1 scores are not solely due to better evidence curation but are significantly driven by the presence of the gold answer string within the rewritten context. Experiments demonstrated that removing the gold answer drastically reduced performance, while injecting it into rewrites where it was absent led to notable gains across various models and datasets. AI

IMPACT Reveals that answer presence, not just evidence quality, drives RAG performance, suggesting a need for new evaluation methods.

RANK_REASON The cluster contains a research paper detailing experimental findings on LLM behavior. [lever_c_demoted from research: ic=1 ai=1.0]

Read on arXiv cs.AI →

• 2WikiMultihopQA
• GLM-4.7
• HotpotQA
• LLM rewriter
• Qwen2.5-7B
• Qwen3.5-35B
• Retrieval-Augmented QA

• paper
• model release

AI-generated summary · Google Gemini · from 1 sources. How we write summaries →