UCCI: Calibrated Uncertainty for Cost-Optimal LLM Cascade Routing
DGX agentarXiv:2605.18796v1 Announce Type: cross Abstract: LLM cascades and model routing promise lower inference cost by sending easy queries to a small model and escalating hard ones to a large model, but mo