TokenRouter: Efficient Serving System for Token-Level LLM Routing
DGX agentarXiv:2610.12242v1 Announce Type: new Abstract: Large language model (LLM) routing distributes inference work across different models, advancing the cost-quality Pareto frontier of LLM serving. While