Same Request, Different Answer: Quantization Amplifies Cache-Induced Divergence in LLM Serving
DGX agentarXiv:2609.04748v1 Announce Type: cross Abstract: Prefix caching, in which a serving engine reuses the key and value tensors of a shared prompt prefix across requests, is enabled by default in the maj