A user on r/MachineLearning shared results from the LongMemEval-S benchmark, achieving 96.0% accuracy using their Papr retrieval system. This performance surpasses other reported scores, including Chronos at 95.6% and Hindsight at 94.6%. The analysis indicated that retrieval recall is nearly saturated, with most errors originating from the reader component rather than retrieval itself. The system utilized the Papr-Embed 0.6B embedding model and Gemini Flash 2.5 reranker. AI
IMPACT Sets a new benchmark for long-context retrieval, potentially influencing future memory-augmented LLM development.
RANK_REASON The item reports on a new benchmark result and analysis of a retrieval system, which falls under research. [lever_c_demoted from research: ic=1 ai=1.0]
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →
