KVShareArena: KV-Cache Reuse Across Contexts and Model Checkpoints
DGX agentarXiv:2609.10266v1 Announce Type: new Abstract: LLM serving systems already reuse KV caches, but only when the reused text sits at the very start of the prompt. Two growing workloads break this condit