RouteNLP: Closed-Loop LLM Routing with Conformal Cascading and Distillation Co-Optimization
DGX agentarXiv:2604.23577v1 Announce Type: new Abstract: Serving diverse NLP workloads with large language models is costly: at one enterprise partner, inference costs exceeded $200K/month despite over 70% of