BELT : BEhavior-Aligned Low-Rank KV Cache Compression with Learned Top-k Rank Allocation
DGX agentarXiv:2610.17966v1 Announce Type: new Abstract: Long-context inference makes the key-value (KV) cache a major memory bottleneck for large language models. We propose BELT, a low-rank KV cache compress