A user on Reddit is seeking help with an Arabic Automatic Speech Recognition (ASR) model that is failing to converge during training. The model, based on a SpeechBrain Conformer-Transformer architecture, uses a combination of CTC and KL divergence loss functions. Despite significant drops in both losses early on, they quickly plateau, resulting in a high Word Error Rate (WER) on validation sets. The user has attempted various adjustments to learning rate, batch size, and vocabulary size without success, and is looking for potential causes or solutions from the community. AI
IMPACT This discussion highlights common challenges in training specialized ASR models, potentially offering insights for other researchers working with similar architectures or languages.
RANK_REASON User is asking for help with a specific machine learning model training issue, which falls under research-level discussion. [lever_c_demoted from research: ic=1 ai=1.0]
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →