How I learned to stop worrying and love StopGrads: Stationarity, Convergence, and a case study on Flow Map Learning
arXiv:2609.16222v1 Announce Type: new Abstract: Stopgrads are widely used in training machine learning models, but stopgrads can alter the gradient, stationary points and convergence guarantees of the