The Model Parking Tax: Quantifying the Hidden Energy Cost of Always-On GPU Model Deployment
DGX agentarXiv:2605.23918v1 Announce Type: cross Abstract: The AI inference industry keeps models loaded in GPU memory around the clock to avoid cold-start latency, implicitly treating idle power as a fixed co