On the Convergence of Muon and Beyond
DGX agentarXiv:2509.15816v5 Announce Type: replace Abstract: The Muon optimizer has demonstrated remarkable empirical success in handling matrix-structured parameters for training neural networks. However, a s
Knowledge catalogue
arXiv:2509.15816v5 Announce Type: replace Abstract: The Muon optimizer has demonstrated remarkable empirical success in handling matrix-structured parameters for training neural networks. However, a s
arXiv:2512.18248v3 Announce Type: replace Abstract: The low-rank adaptation (LoRA) algorithm for fine-tuning large models has grown popular in recent years due to its remarkable performance and low co