Training-Free Halving of Activated Experts in Fine-Grained Mixture-of-Experts Models
DGX agentarXiv:2609.04575v1 Announce Type: cross Abstract: Modern fine-grained Mixture-of-Experts (MoE) models route each token to a small number of experts and renormalize their router probabilities. We show