Researchers have developed ZipCodec, a novel neural audio codec designed for ultra-low-frame-rate streaming speech. Operating at 6.25 Hz and 0.80 kbps with a 160 ms latency, ZipCodec utilizes WavLM distillation and a transformer-based architecture. Experiments demonstrate its superior performance in reconstruction and downstream tasks compared to existing codecs at similar bitrates, while also achieving real-time inference on a CPU. AI
IMPACT This development could significantly improve the efficiency and quality of real-time speech generation and processing systems.
RANK_REASON The cluster describes a new research paper detailing a novel neural audio codec.
Read on Hugging Face Daily Papers →
AI-generated summary · Google Gemini · from 2 sources. How we write summaries →