新基准 Dhārā Bench 针对印度知识体系检索

作者 PulseAugur 编辑部 · [1 个来源] · 2026-11-02 14:23

研究人员推出了 Dhārā Bench，这是一个新的检索基准，旨在评估系统在印度知识体系 (IKS) 方面的表现。该基准包含 12 个类别中的 325 个问题和超过 60,000 个文本片段，并附有将问题链接到相关段落的详细注释。使用 Pyserini 实现的 BM25 基线进行的初步评估显示性能一般，特别是在诗句检索方面存在不足，并且在为多跳问题寻找完整证据方面存在挑战。语料库和评估代码可在 Hugging Face 上公开获取。 AI

影响为专注于特定知识领域的检索系统建立了新的评估标准。

排序理由发布了一篇介绍新基准的学术论文。[lever_c_demoted from research: ic=1 ai=1.0]

在 arXiv cs.IR (Information Retrieval) 阅读 →

AI 生成摘要 · Google Gemini · 来自 1 个来源。我们如何撰写摘要 →

本文如何被排名

Signal score: 2 / 100; Composite score across the factors below. Higher = stronger signal that this story matters right now.
Newsworthiness bucket: Tool; 发布了一篇介绍新基准的学术论文。[lever_c_demoted from research: ic=1 ai=1.0]
Source corroboration: Single-source cluster; Only one publisher covered this so far. Single-source stories can still rank when the publisher is high-authority, but they lack cross-source corroboration.
Topics: paper, other; Editorial topic classification. Feeds into how the story surfaces on /topic/<slug> hub pages and into the per-entity coverage mix.
AI-industry relevance: High; Clearly on-topic for AI-industry coverage.
Story freshness: Same-day; Cluster formed today. Ranking reflects the current source set at time of score.

完整方法见我们的编辑标准。

报道来源 [1]

arXiv cs.IR (Information Retrieval) TIER_1 English(EN) · Mohan Raghavan · 2026-11-02 14:23

Dhārā Bench: An Evidence-Oriented Retrieval Benchmark for Indian Knowledge Systems

Dhārā Bench is a retrieval benchmark for Indian Knowledge Systems (IKS), with 325 questions in 12 categories and 60,121 text chunks from 15 source groups. The categories were developed based on 4,500 questions submitted to the Dhārā application; the evaluation set combines corpus…

本文如何被排名

报道来源 [1]

Dhārā Bench: An Evidence-Oriented Retrieval Benchmark for Indian Knowledge Systems

相关实体

相关话题