When Does Scale-Invariant Optimization Become Unstable? An Exact Schedule Law with Weight Decay
DGX agentarXiv:2609.09116v1 Announce Type: new Abstract: Normalization renders large parts of neural networks effectively scale invariant, inducing a hidden feedback loop in which learning-rate schedules and w