A new paper investigates the quality of annotations for Aspect-Based Sentiment Analysis (ABSA) in German, comparing experts, students, crowdworkers, and large language models (LLMs). The study re-annotated an existing dataset to establish a ground truth and evaluated annotation quality using Inter-Annotator Agreement (IAA). The research also assessed the impact of these different annotation sources on downstream model performance for ABSA subtasks, utilizing BERT, T5, and LLaMA-based models. AI
影响 Provides insights into the trade-offs between annotation reliability and efficiency for dataset construction in under-resourced NLP scenarios.
排序理由 The cluster contains an academic paper detailing a comparative study on annotation quality for NLP tasks.
- Aspect-Based Sentiment Analysis
- Aspect Category Sentiment Analysis
- BERT
- Experts
- German
- Large Language Models
- LLaMA
- Students
- Target Aspect Sentiment Detection
- Inter-Annotator Agreement
AI 生成摘要 · Google Gemini · 来自 2 个来源。 我们如何撰写摘要 →
