KVDrive: A Holistic Multi-Tier KV Cache Management System for Long-Context LLM Inference
arXiv:2605.18071v1 Announce Type: new Abstract: Supporting long-context LLMs is challenging due to the substantial memory demands of the key-value (KV) cache. Existing offloading systems store the ful