ENTITY
Key-Value (KV) cache
Key-Value (KV) cache
PulseAugur coverage of Key-Value (KV) cache — every cluster mentioning Key-Value (KV) cache across labs, papers, and developer communities, ranked by signal.
Total · 30d
0
2 over 90d
Releases · 30d
0
0 over 90d
Papers · 30d
0
1 over 90d
TIER MIX · 90D
TOPICS
RECENT · PAGE 1/1 · 2 TOTAL
-
New framework unifies economic utility with AI model caching
A new paper proposes a theoretical framework that unifies economic principles of marginal utility with machine learning concepts like matrix factorization and the Key-Value (KV) cache in transformer language models. Thi…
-
vLLM's PagedAttention optimizes LLM GPU memory usage
vLLM has introduced PagedAttention, a novel method for managing GPU memory in Large Language Models (LLMs) that significantly reduces waste. Traditional LLM serving frameworks often over-allocate GPU memory for the Key-…