RippleKV: Cross-Layer KV Cache Allocation via Perturbation Propagation
DGX agentarXiv:2608.08684v1 Announce Type: cross Abstract: Long-context LLM inference is bottlenecked by KV cache memory, yet distributing a limited cache budget across layers remains challenging. Existing met