High-Probability Convergence of Clipped SGD under Heavy-Tailed Noise and (L_0,L_1)-Smoothness
arXiv:2505.20817v3 Announce Type: replace-cross Abstract: Gradient clipping is widely used in language-model training to control heavy-tailed gradient noise and can improve convergence guarantees over