Dissecting GPU Utilization for LLM Inference on Nvidia Hopper
DGX agentarXiv:2609.12923v1 Announce Type: cross Abstract: A single SM utilization percentage can make an LLM inference workload look compute-saturated while hiding how much useful work is being done. The prob