A Simple Plug-in for Improving Eviction-Based KV Cache Compression
arXiv:2605.23258v1 Announce Type: new Abstract: KV cache growth is a major bottleneck for long-context inference in large language models. Existing methods are often dominated by binary eviction or re