WiSP: A Working-Set View of Mixture-of-Experts Serving on Extremely Low-Resource Hardware
DGX agentarXiv:2606.21868v1 Announce Type: new Abstract: Modern Mixture-of-Experts (MoE) models place most of their parameters in expert layers, yet only a small fraction of those experts are used for any toke