Researchers have introduced TUSI-Bench, a new benchmark designed to evaluate retrieval-augmented generation (RAG) systems in Persian legal contexts. This benchmark addresses the limitations of existing resources by providing realistic grounding and coverage of legal reasoning. TUSI-Bench is built on a comprehensive legal knowledge framework and includes a knowledge graph to facilitate structured retrieval. It features two evaluation tasks: TUSI-QA for open-ended questions requiring citations and TUSI-Bar for multiple-choice questions derived from Iranian Bar exams. A graph-based retrieval baseline demonstrated an improvement in recall, highlighting the value of structured legal data for RAG systems. AI
IMPACT This benchmark could improve the accuracy and reliability of AI systems in legal applications, particularly in non-English contexts.
RANK_REASON The item describes a new academic benchmark for evaluating AI systems, published on arXiv. [lever_c_demoted from research: ic=1 ai=1.0]
- alphaXiv
- arXiv
- CatalyzeX Code Finder for Papers
- Connected Papers
- DagsHub
- Gotit.pub
- Hugging Face
- Iranian Bar
- Litmaps
- Persian
- ScienceCast
- scite Smart Citations
- Supreme Court of the United States
- TUSI-Bar
- TUSI-Bench
- TUSI-QA
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →