SpecPrefetch: Parameter-Efficient Expert Prefetching for Sparse MoE Foundation Models
DGX agentarXiv:2607.24787v1 Announce Type: new Abstract: Sparse Mixture-of-Experts (MoE) models expand foundation model capacity through conditional expert activation, but their full expert pools remain diffic