PulseAugur
EN
LIVE 11:43:14

New research tackles multilingual ASR challenges with novel approaches

By PulseAugur Editorial · [9 sources] ·

Researchers are exploring new methods for multilingual Automatic Speech Recognition (ASR), particularly for code-switching scenarios where multiple languages are used within a single conversation. One paper investigates generalizing code-switching capabilities to unseen language pairs through model merging, finding limited success. Another project, BaltiVoice, introduces a new speech corpus and fine-tuned Whisper model for the Balti language, significantly improving ASR accuracy. Additionally, a system called WAXAL-NET demonstrates that specialized, smaller ASR models can outperform large multilingual models for African languages, and a real-time multilingual ASR system uses a routing approach with smaller, specialized models to achieve high accuracy and efficiency. AI

IMPACT Advances in multilingual ASR could significantly improve human-AI interaction across diverse linguistic communities and enable more efficient, specialized speech recognition systems.

RANK_REASON Multiple research papers and projects presenting new models, datasets, and techniques for Automatic Speech Recognition (ASR), particularly in multilingual and code-switching contexts.

Read on arXiv cs.CL →

AI-generated summary · Google Gemini · from 9 sources. How we write summaries →

New research tackles multilingual ASR challenges with novel approaches

COVERAGE [9]

  1. arXiv cs.CL TIER_1 English(EN) · Gio Paik, Hyunseo Shin, Soungmin Lee ·

    Towards Truly Multilingual ASR: Generalizing Code-Switching ASR to Unseen Language Pairs

    arXiv:2606.05846v1 Announce Type: new Abstract: Automatic Speech Recognition (ASR) has become a key technology for human--AI interaction. However, code-switching ASR (CS-ASR) remains particularly challenging due to the severe scarcity of multilingual CS speech resources across di…

  2. arXiv cs.CL TIER_1 English(EN) · Soungmin Lee ·

    Towards Truly Multilingual ASR: Generalizing Code-Switching ASR to Unseen Language Pairs

    Automatic Speech Recognition (ASR) has become a key technology for human--AI interaction. However, code-switching ASR (CS-ASR) remains particularly challenging due to the severe scarcity of multilingual CS speech resources across diverse language pairs. Existing approaches primar…

  3. Hugging Face Daily Papers TIER_1 English(EN) ·

    Towards Truly Multilingual ASR: Generalizing Code-Switching ASR to Unseen Language Pairs

    Code-switching automatic speech recognition models show limited generalization across unseen language pairs despite attempts at model merging and domain generalization techniques.

  4. arXiv cs.AI TIER_1 English(EN) · Muhammad Ali ·

    BaltiVoice: A Speech Corpus and Fine-tuned Whisper ASR System for the Balti Language

    arXiv:2606.03504v1 Announce Type: cross Abstract: We present BaltiVoice, a 16.8-hour read-speech corpus for Balti (ISO 639-3: bft), a Tibetic language spoken in Gilgit-Baltistan, Pakistan, with no prior publicly available ASR resources. The corpus contains 10,060 validated uttera…

  5. Hugging Face Daily Papers TIER_1 English(EN) ·

    BaltiVoice: A Speech Corpus and Fine-tuned Whisper ASR System for the Balti Language

    We present BaltiVoice, a 16.8-hour read-speech corpus for Balti (ISO 639-3: bft), a Tibetic language spoken in Gilgit-Baltistan, Pakistan, with no prior publicly available ASR resources. The corpus contains 10,060 validated utterances in native Nastaliq script, derived from Mozil…

  6. arXiv cs.CL TIER_1 English(EN) · Muhammad Ali ·

    BaltiVoice: A Speech Corpus and Fine-tuned Whisper ASR System for the Balti Language

    We present BaltiVoice, a 16.8-hour read-speech corpus for Balti (ISO 639-3: bft), a Tibetic language spoken in Gilgit-Baltistan, Pakistan, with no prior publicly available ASR resources. The corpus contains 10,060 validated utterances in native Nastaliq script, derived from Mozil…

  7. arXiv cs.CL TIER_1 English(EN) · Victor Tolulope Olufemi, Oreoluwa Babatunde, Ramsey Njema, Bolarinwa Gbotemi, Wanchi Lucia Yen, John Uzodinma, Sunday Ajayi, Oluwademilade Williams, Kausar Moshood, Innocent Elendu Anyaele, Akebert Arefaine, Candace Hunzwi, Wongel Dawit Daniel, Emmilly N… ·

    WAXAL-NET: Finetuned Edge ASR Across 19 African Languages

    arXiv:2606.02375v1 Announce Type: new Abstract: We evaluate whether compact domain-specialized ASR models can outperform massively multilingual foundation models for conversational African speech across 19 languages in the WAXAL corpus. Fine-tuned edge models achieve a macro-aver…

  8. arXiv cs.CL TIER_1 English(EN) · Prasenjit Mitra ·

    WAXAL-NET: Finetuned Edge ASR Across 19 African Languages

    We evaluate whether compact domain-specialized ASR models can outperform massively multilingual foundation models for conversational African speech across 19 languages in the WAXAL corpus. Fine-tuned edge models achieve a macro-averaged WER of $38.0\%$ compared to $64.9\%$ for th…

  9. r/MachineLearning TIER_1 English(EN) · /u/JeanMichelRanu ·

    Real-time multilingual ASR using rolling buffers and monolingual models [P]

    <table> <tr><td> <a href="https://www.reddit.com/r/MachineLearning/comments/1ttwfuy/realtime_multilingual_asr_using_rolling_buffers/"> <img alt="Real-time multilingual ASR using rolling buffers and monolingual models [P]" src="https://preview.redd.it/qu5jir6i0p4h1.png?width=140&a…

RELATED ENTITIES

RELATED TOPICS