Holistic Scaling Laws for Optimal Mixture-of-Experts Architecture Optimization
DGX agentarXiv:2603.21862v2 Announce Type: replace Abstract: Scaling laws govern macroscopic resource allocation for LLMs, yet precise architectural configurations for Mixture-of-Experts (MoE) models remain gu