Cluster, Route, Escalate: Cascaded Framework for Cost-Aware LLM Serving
DGX agentarXiv:2606.27457v1 Announce Type: cross Abstract: Efficient deployment of large language models (LLMs) in production forces a trade-off between accuracy and cost. Operators often default to a single m