Taking Tokenization off the Host for Agentic LLM Serving
DGX agentarXiv:2610.13325v1 Announce Type: cross Abstract: Agentic workloads resend long contexts that barely change between calls. Prefix caching now skips most of their prefill, yet every request must still