Outer-Momentum Restarting in High-Dimensional Two-Phase Optimization
DGX agentarXiv:2605.28585v1 Announce Type: new Abstract: Communication-efficient distributed optimizers such as DiLoCo reduce synchronization costs by letting workers perform many local updates before aggregat