Lightweight Scheduling Policies for Continuously Batched LLLM Serving Across GPU Architectures
DGX agentarXiv:2610.15899v1 Announce Type: cross Abstract: Large language model serving is increasingly limited not only by model size and GPU speed, but also by scheduling during autoregressive decoding, wher