Researchers have developed a novel method to reduce "hallucinated transcripts" generated by the Whisper automatic speech recognition model. This training-free, inference-time technique projects decoder activations to suppress unwanted outputs, particularly for inputs with little or no speech. The method demonstrated a significant reduction in hallucination rates, achieving over 92% relative improvement on non-speech benchmarks while offering a controllable trade-off between hallucination suppression and speech recognition accuracy. AI
IMPACT This technique could improve the reliability of speech-to-text systems in real-world scenarios by reducing erroneous transcriptions.
RANK_REASON This is a research paper detailing a new method to improve an existing AI model's performance. [lever_c_demoted from research: ic=1 ai=1.0]
- alphaXiv
- arXiv
- CatalyzeX
- DagsHub
- Gotit.pub
- Hugging Face
- LibriSpeech
- Maryam Abbasihafshejani
- ScienceCast
- Whisper
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →