PulseAugur
EN
LIVE 19:15:55

Brevis system synthesizes programs for lossless tensor compression

Researchers have developed Brevis, a novel system that treats lossless tensor compression as a program synthesis problem. Brevis utilizes a domain-specific language (DSL) with reversible operators to capture tensor structures, enabling the synthesis of compact, executable programs for reconstruction. This approach achieved a 33.93% storage reduction on 10 large model checkpoints, outperforming general-purpose compressors like Zstandard and GZIP, as well as tensor-specific methods like ZipNN and DFloat11. Brevis also demonstrated high-speed compression and decompression rates while ensuring bit-exact reconstruction. AI

IMPACT This new method for tensor compression could significantly reduce storage and transfer costs for large AI model checkpoints.

RANK_REASON The cluster describes a new research paper detailing a novel method for tensor compression. [lever_c_demoted from research: ic=1 ai=1.0]

Read on Hugging Face Daily Papers →

AI-generated summary · Google Gemini · from 1 sources. How we write summaries →

Brevis system synthesizes programs for lossless tensor compression

COVERAGE [1]

  1. Hugging Face Daily Papers TIER_1 English(EN) ·

    Lossless Tensor Compression as Program Synthesis

    Model checkpoints are growing in both number and size, which makes archival, transfer, and deployment increasingly costly. General-purpose compressors can reduce storage requirements but ignore tensor structure, whereas existing tensor-specific compressors rely on fixed and forma…