Researchers have developed a method to adapt a speech foundation model, SraVaani, for Nepali-English code-mixed speech recognition. By fine-tuning the model on a 172.8-hour corpus across six Nepali speech domains, they significantly reduced the word error rate (WER) from 48.6% to 16.3%. This approach also addressed challenges with digits and common symbols not supported by the model's tokenizer, achieving performance comparable to fine-tuned Whisper large-v3-turbo. AI
IMPACT Improves speech recognition capabilities for code-mixed languages, potentially benefiting users in multilingual communication contexts.
RANK_REASON The cluster describes a research paper published on arXiv detailing the adaptation of a speech foundation model. [lever_c_demoted from research: ic=1 ai=1.0]
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →