PulseAugur
EN
LIVE 12:01:25

New benchmark Dhārā Bench targets Indian Knowledge Systems retrieval

By PulseAugur Editorial · [1 sources] ·

Researchers have introduced Dhārā Bench, a new retrieval benchmark designed to evaluate systems on Indian Knowledge Systems (IKS). This benchmark includes 325 questions across 12 categories and over 60,000 text chunks, with detailed annotations linking questions to relevant passages. Initial evaluations using a BM25 baseline implemented with Pyserini show modest performance, highlighting particular weaknesses in verse retrieval and the challenge of finding complete evidence for multi-hop questions. The corpus and evaluation code are publicly available on Hugging Face. AI

IMPACT Establishes a new evaluation standard for retrieval systems focused on a specific domain of knowledge.

RANK_REASON Publication of an academic paper introducing a new benchmark. [lever_c_demoted from research: ic=1 ai=1.0]

Read on arXiv cs.IR (Information Retrieval) →

AI-generated summary · Google Gemini · from 1 sources. How we write summaries →

New benchmark Dhārā Bench targets Indian Knowledge Systems retrieval

How we ranked this

Signal score
2 / 100
Composite score across the factors below. Higher = stronger signal that this story matters right now.
Newsworthiness bucket
Tool
Publication of an academic paper introducing a new benchmark. [lever_c_demoted from research: ic=1 ai=1.0]
Source corroboration
Single-source cluster
Only one publisher covered this so far. Single-source stories can still rank when the publisher is high-authority, but they lack cross-source corroboration.
Topics
paper, other
Editorial topic classification. Feeds into how the story surfaces on /topic/<slug> hub pages and into the per-entity coverage mix.
AI-industry relevance
High
Clearly on-topic for AI-industry coverage.
Story freshness
Same-day
Cluster formed today. Ranking reflects the current source set at time of score.

Full methodology in our editorial standards.

COVERAGE [1]

  1. arXiv cs.IR (Information Retrieval) TIER_1 English(EN) · Mohan Raghavan ·

    Dhārā Bench: An Evidence-Oriented Retrieval Benchmark for Indian Knowledge Systems

    Dhārā Bench is a retrieval benchmark for Indian Knowledge Systems (IKS), with 325 questions in 12 categories and 60,121 text chunks from 15 source groups. The categories were developed based on 4,500 questions submitted to the Dhārā application; the evaluation set combines corpus…

RELATED ENTITIES

RELATED TOPICS