information bottleneck
PulseAugur coverage of information bottleneck — every cluster mentioning information bottleneck across labs, papers, and developer communities, ranked by signal.
-
Researchers explore geometric and information-theoretic framework for self-supervised learning
Researchers have developed a new geometric and information-theoretic framework for encoder-decoder learning, building upon the Information Bottleneck principle. This framework recasts the problem as a rate-distortion ta…
-
New theory unifies KV cache eviction for LLMs, improving long-context generation
Researchers have developed a new method for managing KV cache eviction in large language models, drawing inspiration from the Information Bottleneck principle. This approach, named CapKV, aims to preserve the most predi…
-
Information Bottleneck problem tractable via sufficient statistic reduction
Researchers have demonstrated a method to simplify the Information Bottleneck (IB) problem by reducing it to a lower-dimensional equivalent when a sufficient statistic exists. This reduction is lossless, preserving the …