PulseAugur
EN
LIVE 07:27:47

Hugging Face benchmarks ASR for bilingual customer voice agents

By PulseAugur Editorial · [2 sources] ·

Hugging Face has developed a benchmark to evaluate how well automatic speech recognition (ASR) systems handle code-switched speech, where individuals switch between languages mid-sentence. This is crucial for voice agents serving bilingual customer bases. The benchmark, covering language pairs like Spanish-English and French-English, uses HR and IT service management scenarios. Top-performing models identified include ElevenLabs Scribe V2, Gemini 3 Flash, and Assembly AI Universal 3-Pro, with results reported using Word Error Rate (WER), Semantic Word Error Rate (SWER), and Answer Error Rate (AER). AI

IMPACT Sets a new standard for evaluating voice agents in multilingual enterprise environments, potentially driving improvements in ASR for global customer service.

RANK_REASON The cluster describes a new benchmark and dataset for evaluating ASR systems on code-switched speech, along with performance results for several models.

Read on Hugging Face Blog →

AI-generated summary · Google Gemini · from 2 sources. How we write summaries →

Hugging Face benchmarks ASR for bilingual customer voice agents

How we ranked this

Signal score
0 / 100
Composite score across the factors below. Higher = stronger signal that this story matters right now.
Newsworthiness bucket
Research
The cluster describes a new benchmark and dataset for evaluating ASR systems on code-switched speech, along with performance results for several models.
Source corroboration
2 independent sources
Multiple independent publishers reporting the same story raises confidence that it's real and newsworthy.
Topics
paper, product
Editorial topic classification. Feeds into how the story surfaces on /topic/<slug> hub pages and into the per-entity coverage mix.
AI-industry relevance
High
Clearly on-topic for AI-industry coverage.
Story freshness
84 days old
Aged out of breaking-news scoring windows; ranking reflects the durable signal from the full source set.

Full methodology in our editorial standards.

COVERAGE [2]

  1. Hugging Face Blog TIER_1 English(EN) ·

    Can Voice Agents Handle Bilingual Customers? Benchmarking Frontier ASR on Code-Switched Speech

  2. Mastodon — fosstodon.org TIER_1 日本語(JA) · [email protected] ·

    Can Voice Agents Handle Bilingual Customers? Benchmark Evaluation of Frontier ASR on Code-Switching Speech https:// huggingface.co/blog/ServiceNow -AI/code-switching ※AI-generated auto-post (headline + link) # AI # Generative AI # LL

    【音声エージェントはバイリンガルの顧客に対応できるか？コードスイッチング音声におけるFrontier ASRのベンチマーク評価】 https:// huggingface.co/blog/ServiceNow -AI/code-switching ※AI生成の自動投稿（見出し＋リンク） # AI # 生成AI # LLM # AIGenerated

    LINKS huggingface.co/…/code-switching

RELATED ENTITIES

RELATED TOPICS