Smoothing the Top-k Exposure Boundary for Sparse Mixture-of-Experts
DGX agentarXiv:2610.11575v1 Announce Type: new Abstract: Sparse Mixture-of-Experts models scale parameter capacity efficiently while maintaining a fixed compute budget per token. However, traditional training