Mixture of Many Zero-Compute Experts: A High-Rate Quantization Theory Perspective
arXiv:2510.03151v2 Announce Type: replace Abstract: This paper uses classical high-rate quantization theory to provide new insights into mixture-of-experts (MoE) models for regression tasks. Our MoE i