TopoEP: Topology-Aware Load Balancing for Expert-Parallel MoE Training
arXiv:2609.35481v1 Announce Type: cross Abstract: Dynamic routing creates severe load imbalance in large-scale expert-parallel Mixture-of-Experts (MoE) training, turning GPUs that host hot experts int