Probe-Space Preconditioning for Fast and Stable Zero-Order Training
DGX agentarXiv:2609.38095v1 Announce Type: new Abstract: Backpropagation (BP) dominates deep learning but imposes a massive memory tax. For example, training OPT-30B with Adam requires approx 600GB of GPU memo