Benchmarking KV-Cache Optimizations across Task Quality and System Performance for Long-Context Serving
DGX agentarXiv:2607.05399v1 Announce Type: cross Abstract: Large language model serving is increasingly limited by KV-cache growth under long-context workloads, yet existing KV-cache compression techniques are