Scale-Invariant Neural Network Optimization: Norm Geometry and Heavy-Tailed Noise
DGX agentarXiv:2605.18528v1 Announce Type: cross Abstract: A growing lesson from neural network optimization is that optimizer design should respect how the model is parametrized. Scale-invariant methods becom