Large Spikes in Stochastic Gradient Descent: A Large-Deviations View
DGX agentarXiv:2603.10079v2 Announce Type: replace Abstract: Large loss spikes in stochastic gradient descent are studied through a rigorous large-deviations analysis for a shallow, fully connected network in