Researchers have introduced ImgMT, a new dataset and benchmark designed to evaluate text-in-image translation capabilities. This dataset, derived from localized SVG illustrations on Wikimedia Commons, includes over 35,000 image pairs across 129 languages and supports evaluation of both text extraction and translation quality. Initial benchmarking of multimodal large language models revealed that the source language and writing system significantly impact translation performance. AI
IMPACT This dataset could advance research in multimodal AI by providing a standardized way to evaluate text-in-image translation.
RANK_REASON The cluster contains a research paper detailing a new dataset and benchmark for a specific AI task. [lever_c_demoted from research: ic=1 ai=1.0]
- arXiv
- ImgMT
- Multimodal Large Language Models
- SVG
- Text-in-Image Translation
- Wikimedia Commons
- Wikipedia
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →