Researchers have developed a novel method called oracle-guided fine-tuning to improve Automatic Speech Recognition (ASR) post-editing using large language models. This technique leverages N-best hypotheses to create curated training data, including corrections, regularizers, and hard negatives, to teach models when to select the best hypothesis or rewrite the transcript. The approach aims to reduce word error rates and suppress hallucinations, showing promising results with models around 3 billion parameters on proprietary datasets, though gains were less conclusive on the public Common Voice dataset. AI
IMPACT This research could lead to more accurate and reliable ASR systems by improving how large language models handle transcript corrections.
RANK_REASON This is a research paper detailing a new fine-tuning method for ASR post-editing. [lever_c_demoted from research: ic=1 ai=1.0]
- arXiv
- Common Voice
- Hugging Face
- N-best hypotheses
- Select or Rewrite: Oracle-Guided Fine-Tuning for Generative ASR Post-Editing from N-Best Hypotheses
- word error rate
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →