iS-KV: Online Low-Rank KV Cache Compression via Block-Incremental SVD
DGX agentarXiv:2610.02815v1 Announce Type: new Abstract: Long chain-of-thought reasoning substantially increases KV-cache memory during autoregressive decoding, as every generated token introduces new key and