PulseAugur
EN
LIVE 15:09:36

SpeechLLMs show bias against Eastern European accents, research finds

By PulseAugur Editorial · [1 sources] ·

A new research paper has quantified intersectional bias in Speech Large Language Models (SpeechLLMs). The study used 2,880 controlled interactions across six English accents and two gender presentations, employing voice cloning to maintain consistent linguistic content. Results indicate that Eastern European-accented speech, particularly from female-presenting voices, receives lower helpfulness scores, though politeness remains consistent. While LLM judges detected these biases, human evaluators demonstrated higher sensitivity to accent-based differences. AI

IMPACT Highlights the need for more nuanced bias detection in speech-based AI systems, particularly concerning intersectional factors like accent and gender.

RANK_REASON Academic paper detailing a new evaluation methodology and findings on bias in SpeechLLMs. [lever_c_demoted from research: ic=1 ai=1.0]

Read on arXiv cs.CL →

AI-generated summary · Google Gemini · from 1 sources. How we write summaries →

SpeechLLMs show bias against Eastern European accents, research finds

COVERAGE [1]

  1. arXiv cs.CL TIER_1 English(EN) · Shree Harsha Bokkahalli Satish, Christoph Minixhofer, Maria Teleki, James Caverlee, Ond\v{r}ej Klejch, Peter Bell, Gustav Eje Henter, \'Eva Sz\'ekely ·

    The Voice Behind the Words: Quantifying Intersectional Bias in SpeechLLMs

    arXiv:2603.16941v2 Announce Type: replace-cross Abstract: Speech Large Language Models (SpeechLLMs) process spoken input directly, retaining cues such as accent and perceived gender that were previously removed in cascaded pipelines. This introduces speaker identity dependent var…

RELATED TOPICS