New benchmark LCSHBench aids AI subject cataloging

Researchers have introduced LCSHBench, a new benchmark dataset for evaluating automated subject cataloging systems, particularly for Library of Congress Subject Headings (LCSH). The dataset comprises 22,346 books in 15 languages, sourced from open catalogs, and includes records where at least two independent cataloging agencies agreed on the LCSH assignment. LCSHBench accounts for both exact heading matches and conceptual similarities, addressing the common discrepancy between topic agreement and precise heading expression among libraries. Initial experiments show that a fine-tuned embedder model can improve performance on this benchmark. AI

影响 Provides a standardized evaluation for AI systems performing subject cataloging, potentially improving library resource discovery.

排序理由 The cluster describes a new academic paper introducing a benchmark dataset for AI research. [lever_c_demoted from research: ic=1 ai=1.0]

在 arXiv cs.AI 阅读 →

• Harvard
• LCSHBench
• Library of Congress Subject Heading Assignment

• 论文
• 产品

AI 生成摘要 · Google Gemini · 来自 1 个来源。 我们如何撰写摘要 →