A new benchmark study explores the effectiveness of generative AI models compared to supervised Extreme Multi-Label Classification (XMLC) methods for automated subject indexing of German scientific literature. The research, conducted using data from the German National Library, found that while transformer-based dense features in supervised XMLC performed well on overall binary relevance metrics, LLM-based generative methods offered superior results for graded relevance and indexing terms in the long tail of the subject vocabulary. This suggests generative AI presents a promising alternative for future library indexing applications. AI
IMPACT Generative AI shows promise for improving the accuracy and efficiency of automated subject indexing in libraries.
RANK_REASON The cluster contains an academic paper detailing a benchmark study on AI methods for a specific task.
- alphaXiv
- arXiv
- DagsHub
- generative artificial intelligence
- German National Library
- Gotit.pub
- Hugging Face
- ScienceCast
- Transformer++
- xmlchars
AI-generated summary · Google Gemini · from 2 sources. How we write summaries →