PulseAugur
中
实时 05:15:39
English(EN) Can Retrievers Find the Same Paper from Different Aspects? A Multi-Aspect Full-Paper Scientific Retrieval Benchmark

新的MAPLE基准评估多方面科学论文检索

研究人员推出了MAPLE,一个旨在评估科学论文检索系统的新基准。与目前关注单一查询-论文相关性的基准不同,MAPLE评估检索器根据论文的动机、方法和实验结果一致找到论文的能力。该基准包含2095个针对近期机器学习和自然语言处理论文的查询,整合了文本和多模态内容。实验表明存在显著的性能差距,最好的模型在跨所有方面检索论文时仍有困难,这凸显了对更全面检索方法的需求。 AI

影响 该基准有望推动更先进的AI系统在科学文献检索和分析领域的发展。

排序理由 该项目描述了一个用于评估科学论文检索系统的新基准,属于研究范畴。[lever_c_demoted from research: ic=1 ai=1.0]

在 arXiv cs.IR (Information Retrieval) 阅读 →

AI 生成摘要 · Google Gemini · 来自 1 个来源。 我们如何撰写摘要 →

新的MAPLE基准评估多方面科学论文检索

本文如何被排名

Signal score
0 / 100
Composite score across the factors below. Higher = stronger signal that this story matters right now.
Newsworthiness bucket
Tool
该项目描述了一个用于评估科学论文检索系统的新基准,属于研究范畴。[lever_c_demoted from research: ic=1 ai=1.0]
Source corroboration
Single-source cluster
Only one publisher covered this so far. Single-source stories can still rank when the publisher is high-authority, but they lack cross-source corroboration.
Topics
paper, other
Editorial topic classification. Feeds into how the story surfaces on /topic/<slug> hub pages and into the per-entity coverage mix.
AI-industry relevance
High
Clearly on-topic for AI-industry coverage.
Story freshness
68 days old
Aged out of breaking-news scoring windows; ranking reflects the durable signal from the full source set.

完整方法见我们的编辑标准。

报道来源 [1]

  1. arXiv cs.IR (Information Retrieval) TIER_1 English(EN) · Yue Zhang ·

    检索器能否从不同方面找到同一篇论文?一个多方面全文科学文献检索基准

    Scientific papers contain multiple searchable facets such as background, methods. However, many paper retrieval benchmarks merely evaluate individual query-paper relevance, while overlooking other facets of the same paper. To bridge this gap, we introduce MAPLE, an expert-validat…