Benchmarking Language Modeling for Lossless Compression of Full-Fidelity Audio
Researchers have developed a new byte-level tokenization schema called Trilobyte for language models to achieve lossless compression of full-fidelity audio. This method addresses the vocabulary scaling issues that arise with higher bit depths in audio, enabling practical compression for 16-bit and 24-bit audio. While the approach shows state-of-the-art compression for 8-bit and 16-bit audio, outperforming existing codecs like FLAC, the gains become less significant as bit depth increases beyond 8-bit. AI
IMPACT This research demonstrates a novel application of language models for audio compression, potentially improving efficiency for high-fidelity audio storage and transmission.