Generic Expert Coverage for Pruning SparseMixture-of-Experts Language Models
arXiv:2607.01710v1 Announce Type: new Abstract: Sparsely activated Mixture-of-Experts (MoE) language models contain substantial structured redundancy among routed experts, but pruning them without dow