Complete-muE: Optimal Hyperparameter Transfer and Scaling for MoE Models
DGX agentarXiv:2605.23893v1 Announce Type: new Abstract: We propose Complete-muE, a framework which targets hyperparameter transfer across dense FFN and any Mixture-of-Experts (MoE) setups in transformer block