Gradient descent at the Edge of Stability: free energy model and kinetic description of the two-layer network
DGX agentarXiv:2606.05326v1 Announce Type: cross Abstract: We study the dynamics of gradient descent in the Edge of Stability regime, where the learning rate is large enough to induce persistent oscillations i