DuoRate: Two-Rate Per-Expert Precision Allocation for Mixture-of-Experts Serving
arXiv:2610.13328v1 Announce Type: new Abstract: Serving a Mixture-of-Experts (MoE) model pays for expert precision twice: the resident footprint pays for every expert the router can reach, while each