A new research paper explores the limitations of current machine translation (MT) evaluation metrics by proposing extrinsic discourse evaluations. The study introduces an entity counting task to assess referential consistency and uses the Welfare Diplomacy game to evaluate communication and coordination in interactive settings. Findings indicate that high intrinsic MT quality does not guarantee downstream discourse success, and translation failures can significantly impact coordination in goal-oriented environments. AI
影响 Highlights the need for new evaluation methods that capture real-world performance of machine translation systems.
排序理由 The cluster contains an academic paper published on arXiv detailing new research methods for evaluating machine translation.
- alphaXiv
- arXiv
- CatalyzeX
- DagsHub
- Gotit.pub
- Hugging Face
- machine translation
- ScienceCast
- Welfare Diplomacy
- Connected Papers
- Litmaps
- scite Smart Citations
AI 生成摘要 · Google Gemini · 来自 2 个来源。 我们如何撰写摘要 →