vLLM Semantic Router: Signal Driven Decision Routing for Mixture-of-Modality Models
DGX agentarXiv:2603.04444v3 Announce Type: replace-cross Abstract: As large language models (LLMs) diversify across modalities, capabilities, and cost profiles, the problem of intelligent request routing -- se