Researchers have developed a novel framework utilizing LLM-driven evolutionary program search to enhance Generative Retrieval (GR) systems. This approach addresses the challenge of optimizing discrete, interdependent components of Semantic Identifiers (SIDs) that cannot be easily fine-tuned with gradients. By employing a 31B model for component mutation and a 1M-parameter proxy decoder for rapid feedback, the system significantly improves retrieval performance on benchmark datasets. AI
IMPACT This research demonstrates a practical method for improving retrieval systems, potentially leading to more efficient and accurate search and recommendation engines.
RANK_REASON The cluster contains an academic paper detailing a new method for optimizing AI components.
Read on arXiv cs.IR (Information Retrieval) →
- 1B target generator
- 1M-parameter proxy decoder
- 31B model
- Generative Retrieval
- Hugging Face
- LLM-driven evolutionary program search
- MSMARCO300K
- NQ320K
- Recall@1
- Recall@100
- Semantic Identifiers
AI-generated summary · Google Gemini · from 2 sources. How we write summaries →