Adaptive Preconditioners Trigger Loss Spikes in Adam
DGX agentarXiv:2506.04805v2 Announce Type: replace Abstract: Loss spikes commonly emerge during neural network training with the Adam optimizer across diverse architectures and scales, yet their underlying mec