LLM Inference Under Bursty Workload Distribution: Modifying the WAIT Algorithm
arXiv:2608.06135v1 Announce Type: new Abstract: Large Language Models (LLMs) such as ChatGPT and Claude are widely used for information retrieval and problem-solving. Recent work has focused on improv