block diffusion

Block diffusion models achieve constant-size cache with Mamba architecture

A new research paper introduces a novel approach to caching for block diffusion language models, enabling constant-size memory usage regardless of context length. This method, particularly effective with Mamba-based arc…