On the Provable Suboptimality of Momentum SGD in Nonstationary Stochastic Optimization
DGX agentarXiv:2601.12238v4 Announce Type: replace-cross Abstract: In this paper, we provide a comprehensive theoretical analysis of Stochastic Gradient Descent (SGD) and its momentum variants (Polyak Heavy-Ba