Towards Efficient Large Language Model Serving: A Survey on System-Aware KV Cache Optimization
DGX agentarXiv:2607.08057v1 Announce Type: cross Abstract: Despite the rapid advancements of large language models (LLMs), LLM serving systems remain memory-intensive and costly. The key-value (KV) cache, whic