ResidualKV: Residual-Based KV Cache Compression for Efficient Long-Context Inference
DGX agentarXiv:2602.08005v2 Announce Type: replace-cross Abstract: Efficient long-context inference faces two coupled bottlenecks: KV-cache memory grows linearly with context length, while attention computatio