MAPS: Memory-Aware Predictive Scheduling Framework for Large Language Model Serving
DGX agentarXiv:2609.15359v1 Announce Type: new Abstract: The surge of large language model (LLM) applications on personal devices imposes massive, bursty workloads on cloud serving infrastructure. While prefil