LLMVisor: A Real-Time Latency Attribution Model for Multi-Tenant LLM Serving
DGX agentarXiv:2608.08382v1 Announce Type: new Abstract: As LLM inference shifts to multi-tenant GPU clusters, co-batching improves throughput but obscures per-tenant usage and limits control. Enabling fractio