Governing the KV Cache: Preventing Timing Side-Channel Leakage in Multi-Tenant LLM Inference
DGX agentarXiv:2608.09225v1 Announce Type: cross Abstract: The key-value (KV) cache is the primary throughput optimization in modern large language model (LLM) inference, enabling prefix reuse across requests.