To Use or not to Use Muon: How Simplicity Bias in Optimizers Matters
DGX agentarXiv:2603.00742v2 Announce Type: replace Abstract: While Adam has long been the ubiquitous default optimizer for deep neural networks, Muon has recently seen rapid adoption due to its superior traini