AgentKV: Phase-Aware KV Eviction for Agentic LLMs
arXiv:2609.14872v1 Announce Type: cross Abstract: Agentic serving can consume orders of magnitude more tokens than chatbot workloads, stressing both KV-cache capacity and decode-time bandwidth. Most K