研究人员推出了HardMTBench，这是一个旨在评估中英机器翻译系统在知识密集型领域表现的新基准。FLORES-200等现有基准已饱和，大多数大型语言模型得分相似且都很高。HardMTBench通过涵盖12个领域并使用基于LLM的评估器来评估翻译难度、术语和知识密度来解决这一问题。这个新基准拓宽了系统之间的性能差距，并揭示了先前指标所忽略的特定领域弱点。 AI
影响 HardMTBench旨在揭示机器翻译系统的特定术语和知识弱点，推动开发超越通用质量指标。
排序理由 该集群包含一篇介绍机器翻译新基准的学术论文。
AI 生成摘要 · Google Gemini · 来自 2 个来源。 我们如何撰写摘要 →
arXiv:2605.28315v1 Announce Type: new Abstract: General-purpose machine translation benchmarks such as FLORES-200 have reached a saturation regime on Chinese-English pairs, where modern large language models cluster within a narrow band of high scores. Across 22 systems, FLORES-2…
General-purpose machine translation benchmarks such as FLORES-200 have reached a saturation regime on Chinese-English pairs, where modern large language models cluster within a narrow band of high scores. Across 22 systems, FLORES-200 zh-en GEMBA scores fall in a 7.87-point range…