DynaTrain: Fast Online Parallelism Switching for Elastic LLM Training
DGX agentarXiv:2605.18815v1 Announce Type: new Abstract: Modern large language model (LLM) training is inherently dynamic: resource fluctuations, RLHF phase shifts, and cluster elasticity continually reshape t