Value-Aware Stochastic KV Cache Eviction for Reasoning Models
DGX agentarXiv:2606.03928v1 Announce Type: cross Abstract: Reasoning models improve accuracy through extended chains of thought, but their long outputs create a memory and compute bottleneck. KV cache eviction