PersistentKV: Page-Aware Decode Scheduling for Long-Context LLM Serving on Commodity GPUs
DGX agentarXiv:2606.26666v1 Announce Type: new Abstract: Autoregressive large language model (LLM) serving is increasingly limited by key-value (KV) cache movement rather than dense matrix multiplication. Mode