Towards a Statistical Understanding of Mixture-of-Experts
DGX agentarXiv:2609.03501v1 Announce Type: cross Abstract: Mixture-of-experts (MoE) architectures increase model capacity by combining a collection of expert predictors through input-dependent routing, while o