PulseAugur
中
实时 06:56:44
English(EN) LEGAL-UQA: Testing Constitutional Question-Answering Systems for Urdu Speakers with a Parallel English-Urdu Benchmark

新基准测试乌尔都语宪法问答系统

研究人员开发了LEGAL-UQA,这是一个旨在评估针对乌尔都语使用者关于巴基斯坦宪法问答系统的基准。该基准包含619个平行的英乌问答对,能够分别测试问答能力和段落检索能力。初步评估显示,模型性能排名可能因所使用的相似度测量方法而异,并且简单的词语匹配方法在段落检索方面比测试的嵌入方法更有效。 AI

影响 该基准可以改进面向乌尔都语使用者的法律信息助手的开发,从而提高获取宪法权利信息的途径。

排序理由 该集群包含一篇详细介绍用于评估AI系统的新基准的学术论文。[lever_c_demoted from research: ic=1 ai=1.0]

在 arXiv cs.AI 阅读 →

AI 生成摘要 · Google Gemini · 来自 1 个来源。 我们如何撰写摘要 →

新基准测试乌尔都语宪法问答系统

本文如何被排名

Signal score
37 / 100
Composite score across the factors below. Higher = stronger signal that this story matters right now.
Newsworthiness bucket
Tool
该集群包含一篇详细介绍用于评估AI系统的新基准的学术论文。[lever_c_demoted from research: ic=1 ai=1.0]
Source corroboration
Single-source cluster
Only one publisher covered this so far. Single-source stories can still rank when the publisher is high-authority, but they lack cross-source corroboration.
Topics
paper, other
Editorial topic classification. Feeds into how the story surfaces on /topic/<slug> hub pages and into the per-entity coverage mix.
AI-industry relevance
High
Clearly on-topic for AI-industry coverage.
Story freshness
Breaking (< 6h)
Fresh story with cross-source coverage still developing. Ranking may shift as more sources report.

完整方法见我们的编辑标准。

报道来源 [1]

  1. arXiv cs.AI TIER_1 English(EN) · Faizan Faisal, Umair Yousaf, Muhammad Hassnain, Zeerak Babar ·

    LEGAL-UQA:为乌尔都语使用者测试宪法问答系统,附带平行英乌基准

    arXiv:2410.13013v2 Announce Type: replace-cross Abstract: Legal information assistants could help Urdu speakers understand their constitutional rights, but building reliable systems requires test data and evaluation methods suited to the language. We present LEGAL-UQA, a parallel…