KV-RM: Regularizing KV-Cache Movement for Static-Graph LLM Serving
DGX agentarXiv:2605.09735v1 Announce Type: cross Abstract: Static-graph LLM decoders provide predictable launches, fixed tensor shapes, and low submission overhead, but online decoding exposes highly irregular