SpecFit: Not All Draft Tokens Cost the Same in Offloaded MoE Inference
DGX agentarXiv:2610.15417v1 Announce Type: new Abstract: Mixture-of-experts (MoE) models activate only a few experts per token, but when their expert weights are offloaded to host memory, host-to-device (H2D)