Routing by Analogy: kNN-Augmented Expert Assignment for Mixture-of-Experts
DGX agentarXiv:2601.02144v2 Announce Type: replace-cross Abstract: Mixture-of-Experts (MoE) architectures scale large language models efficiently by employing a parametric ``router'' to dispatch tokens to a sp