Cactus Compute has developed Whistle, a compact 16.9 MB speech-to-text model designed to run efficiently on a CPU. Benchmarks on the LibriSpeech test-other dataset show Whistle achieving a 10.47% word error rate, outperforming the base Whisper model by 2.19 points when using greedy decoding. Additionally, Whistle demonstrated a 5.7x speed advantage over Whisper on ten-second audio clips. AI
IMPACT Offers a more efficient, CPU-bound alternative for speech-to-text tasks, potentially lowering inference costs.
RANK_REASON The item describes a new model release and its benchmark performance against an existing model. [lever_c_demoted from research: ic=1 ai=1.0]
Read on Mastodon — mastodon.social →
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →