A new study published on arXiv reveals that while AI-generated translations of literary texts are considered "fine" by readers, human translations are still preferred for their immersive quality and clarity. The research involved 15 avid readers comparing human and AI translations of novels in French, Polish, and Japanese into English. Although readers could not reliably distinguish between the two, they favored human translations, noting that AI translation quality varied more within a single book. The study also found that current automatic metrics, including LLM-as-a-judge approaches, fail to accurately reflect reader preferences. AI
IMPACT Suggests human oversight and nuanced evaluation are still critical for high-quality literary translation.
RANK_REASON Academic paper on AI translation quality and reader preference.
AI-generated summary · Google Gemini · from 2 sources. How we write summaries →