A new research paper explores the limitations of current machine translation (MT) evaluation metrics by proposing extrinsic discourse evaluations. The study introduces an entity counting task to assess referential consistency and uses the Welfare Diplomacy game to evaluate communication and coordination in interactive settings. Findings indicate that high intrinsic MT quality does not guarantee downstream discourse success, and translation failures can significantly impact coordination in goal-oriented environments. AI
IMPACT Highlights the need for new evaluation methods that capture real-world performance of machine translation systems.
RANK_REASON The cluster contains an academic paper published on arXiv detailing new research methods for evaluating machine translation.
- alphaXiv
- arXiv
- CatalyzeX
- DagsHub
- Gotit.pub
- Hugging Face
- machine translation
- ScienceCast
- Welfare Diplomacy
- Connected Papers
- Litmaps
- scite Smart Citations
AI-generated summary · Google Gemini · from 2 sources. How we write summaries →