A Year in LLM Serving: Workload Evolution, Caching and Load-Balancing
arXiv:2608.13573v1 Announce Type: new Abstract: Large Language Model (LLM) serving has become a critical cloud workload, and realistic traces are essential for motivating and benchmarking serving syst