Whisfusion uses masked diffusion for faster, more accurate speech recognition

Researchers have developed Whisfusion, a novel non-autoregressive system for automatic speech recognition (ASR) that utilizes masked diffusion models. This approach aims to match the accuracy of traditional autoregressive models while significantly improving inference speed. Whisfusion achieves this by training a diffusion decoder on top of frozen Whisper-large-v3 audio embeddings, enabling parallel decoding and outperforming existing models in both speed and accuracy across multiple languages. AI

IMPACT Establishes masked diffusion as a viable, high-throughput alternative for multilingual ASR, potentially accelerating real-time transcription applications.

RANK_REASON This is a research paper detailing a new model architecture for ASR. [lever_c_demoted from research: ic=1 ai=1.0]

Read on arXiv cs.AI →

• Canary
• Qwen3-ASR
• Taeyoun Kwon
• Whisfusion
• Whisper-large-v3

• paper
• model release

AI-generated summary · Google Gemini · from 1 sources. How we write summaries →