Researchers have developed ReuseGR, a novel generative retrieval system designed to improve efficiency and personalization. The system decouples offline query planning from online personalized completion, allowing a smaller model to reuse computation from a larger model across similar requests. This approach significantly reduces latency while maintaining or improving retrieval quality and user engagement metrics, as demonstrated in offline experiments and a user-level A/B test. AI
IMPACT This system's approach to decoupling and reusing computation could significantly reduce serving costs for large generative models in retrieval applications.
RANK_REASON This item is a research paper detailing a new system for generative retrieval. [lever_c_demoted from research: ic=1 ai=1.0]
Read on arXiv cs.IR (Information Retrieval) →
- alphaXiv
- BudgetCut
- CatalyzeX
- CORE Recommender
- DagsHub
- FLNA
- Gotit.pub
- Grpo
- Hugging Face
- Influence Flower
- Path KD
- ReuseCut
- ReuseGR
- ScienceCast
- Semantic IDs
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →