Muon in Vision Transformers: Optimizer-Recipe Interactions and Gradient Spectra
DGX agentarXiv:2605.24770v1 Announce Type: new Abstract: Muon is a recently developed matrix-aware optimizer that has shown strong results in transformer training, but its behavior in vision transformers (ViTs