ARC-KV: Amortizing Anchor Search for Reconstruction-Based KV Cache Compaction
DGX agentarXiv:2609.36835v1 Announce Type: new Abstract: Long-context large language model inference is bottlenecked by KV caches that grow linearly with sequence length. This burden is especially severe for l