Researchers have developed ZipCodec, a novel neural audio codec designed for ultra-low-frame-rate streaming speech. Operating at 6.25 Hz with a bitrate of 0.80 kbps and a latency of 160 ms, ZipCodec significantly outperforms existing streaming codecs in reconstruction quality and downstream tasks. The system leverages large-scale WavLM distillation, a transformer-based architecture, and a scalar spherical quantizer, enabling real-time inference on consumer CPUs despite its 842 million parameters. AI
IMPACT This development could lead to more efficient and lower-latency speech generation and coding systems.
RANK_REASON Research paper detailing a new model and its performance. [lever_c_demoted from research: ic=1 ai=1.0]
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →