LaCache: Robust Semantic Caching for LLM Serving
DGX agentarXiv:2608.01718v2 Announce Type: replace Abstract: Semantic caching, reusing responses to answer semantically similar queries, has seen growing adoption in LLM serving, offering faster responses and