HyDRA: Hybrid Dynamic Routing Architecture for Heterogeneous LLM Pools
arXiv:2605.17106v1 Announce Type: new Abstract: Production LLM deployments increasingly maintain heterogeneous model pools spanning order-of-magnitude cost differences. Existing routers make binary st