AgentKV

AgentKV improves LLM efficiency with phase-aware KV eviction

Researchers have developed AgentKV, a new method for managing KV cache in agentic Large Language Models (LLMs). AgentKV addresses the issue that traditional KV eviction methods, which rely on recent tokens, fail to acco…