EpiCache
PulseAugur coverage of EpiCache — every cluster mentioning EpiCache across labs, papers, and developer communities, ranked by signal.
-
Nvidia, NYU, and Together AI advance KV cache compression and throughput
Researchers from Nvidia and NYU have developed TurboQuant, a method for KV cache compression that achieves theoretical optimality at 3-4 bits. Concurrently, Together AI's OSCAR system offers an 8x increase in throughput…
-
New LLM KV Cache Compression Methods Tackle Safety and Efficiency
Researchers are developing new methods to compress the Key-Value (KV) cache in large language models (LLMs) to reduce memory usage and improve inference efficiency. AnchorKV focuses on safety by biasing token retention …
-
New methods tackle LLM KV cache compression for long contexts
Multiple research papers released in May and June 2026 propose novel methods for compressing the Key-Value (KV) cache in large language models (LLMs). These techniques aim to reduce the significant memory overhead assoc…