Adaptive Optimization via Momentum on Variance-Normalized Gradients
DGX agentarXiv:2602.10204v2 Announce Type: replace Abstract: We introduce MVN-Grad (Momentum on Variance-Normalized Gradients), an Adam-style optimizer that improves stability and performance by combining two