Minima-KV: Retention-Preserving KV Cache Compression with Mixed-Format Paged Attention
DGX agentarXiv:2608.23834v1 Announce Type: new Abstract: The key-value (KV) cache is a primary capacity and bandwidth bottleneck in long-context LLM serving. We present Minima-KV, a retention-preserving hierar