OjaKV: Context-Aware Online Low-Rank KV Cache Compression
DGX agentarXiv:2509.21623v2 Announce Type: replace-cross Abstract: The expanding long-context capabilities of large language models are constrained by a significant memory bottleneck: the key-value (KV) cache