ETH: Data-Balanced Heterogeneous Pipeline Parallelism for Training Large Models
DGX agentarXiv:2610.22035v1 Announce Type: cross Abstract: Current heterogeneity-aware training systems for large models balance workloads by assigning unequal numbers of layers across pipeline stages, a strat