Muon Under Gradient Noise and the Limits of Orthogonalization Near Optima
arXiv:2609.32861v1 Announce Type: new Abstract: Muon replaces the momentum buffer of each weight matrix by its orthogonal polar factor. We ask what this orthogonalization does near an optimum, where m