AdamNX: An Adam improvement algorithm based on a novel exponential decay mechanism for the second-order moment estimate
DGX agentarXiv:2511.13465v5 Announce Type: replace Abstract: This paper studies the exponential decay mechanism of the second-moment estimate in Adam. We propose AdamNX and a time-varying second-moment decay r