STAR: Rethinking MoE Routing as Structure-Aware Subspace Learning
DGX agentarXiv:2606.08814v1 Announce Type: new Abstract: Mixture-of-Experts (MoE) scales model capacity efficiently by selectively routing inputs to a specialized subset of experts. However, input-expert speci