Researchers have developed a new framework for multilingual automatic speech recognition (ASR) that uses a language-aware agent to optimize data sampling during training. This agent analyzes ASR errors from linguistic perspectives and uses this feedback, along with training statistics and resource constraints, to select optimal sampling strategies. Experiments on twelve Common Voice languages with the Whisper-medium model demonstrated that this approach surpasses full-data training in performance while using fewer resources and significantly accelerating convergence. AI
IMPACT This framework could lead to more efficient training of multilingual ASR systems, reducing computational costs and improving performance.
RANK_REASON The cluster describes a research paper detailing a new framework for ASR. [lever_c_demoted from research: ic=1 ai=1.0]
- Agentic Data Sampling Framework for Multilingual ASR via Linguistic-Aware Error-Driven Optimization
- arXiv
- Common Voice
- Hugging Face
- Whisper-medium
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →