CacheProbe: Auditing Prompt Cache Isolation in Gateway APIs
arXiv:2605.30613v1 Announce Type: cross Abstract: Over the past year, prompt caching in Large Language Models (LLMs) has become increasingly more popular across inference APIs. Prompt caching helps sa