A new study published on arXiv reveals significant language disparities in the performance of typed decision interfaces, which are used in AI systems to determine whether to automatically classify an item or pass it to a human. When tested with a confidence threshold of 0.9, these interfaces consistently classified requests in English more often than in any other language, even when the requests were answered correctly in both languages. This coverage gap persisted across multiple vendors and was not detected by standard calibration metrics on one interface. Translating inputs into English nearly eliminated the gap, suggesting that language bias is a critical factor in the equitable deployment of AI decision-making tools. AI
IMPACT Highlights the need for multilingual fairness in AI systems, potentially impacting global deployment and accessibility.
RANK_REASON The cluster contains a research paper detailing findings on AI system performance. [lever_c_demoted from research: ic=1 ai=1.0]
- alphaXiv
- arXiv
- CatalyzeX Code Finder for Papers
- DagsHub
- English
- Gotit.pub
- Hugging Face
- Influence Flower
- languages of Africa
- MASSIVE
- ScienceCast
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →