Distributional Approximate Nearest Neighbour Search for Uncertainty-Aware Retrieval
Researchers have developed DINOSAUR, a new framework for approximate nearest neighbor search that accounts for uncertainty in item embeddings. This approach aims to improve retrieval systems by sampling multiple embeddings per item and user, thereby addressing the bias towards popular items and enhancing the discovery of long-tail content. The framework is designed to be compatible with existing infrastructure and shows promise in expanding retrieval coverage with minimal impact on offline recall. AI
IMPACT Enhances recommender systems by improving long-tail content discovery and reducing bias towards popular items.