Cost-free Spectral Estimation for Adaptive Newton--Schulz in Matrix Optimizers
DGX agentarXiv:2609.33047v1 Announce Type: new Abstract: Matrix optimizers such as Muon transform each momentum matrix through an approximate orthogonalization, typically implemented by a small number of Newto