Enabling KV Caching of Shared Prefix for Diffusion Language Models
DGX agentarXiv:2606.07571v1 Announce Type: cross Abstract: Key-value (KV) caching for shared prefixes is essential for high-throughput large language model (LLM) serving, but it faces critical challenges in em