Where Does Warm-Up Come From? Adaptive Scheduling for Norm-Constrained Optimizers
DGX agentarXiv:2602.05813v2 Announce Type: replace Abstract: We study adaptive learning rate scheduling for norm-constrained optimizers (e.g., Muon and Lion). We introduce a generalized smoothness assumption u