Stochastic Estimation of the Layer-wise Hessian Trace for Monitoring Neural-network Training
DGX agentarXiv:2605.25674v1 Announce Type: new Abstract: The loss and the norm of its gradient separate the healthy and the pathological regimes of neural-network training only weakly, whilst the curvature of