On the Nonlinearity of Learning Rate Scaling for LLM Training
DGX agentarXiv:2606.29158v1 Announce Type: cross Abstract: Learning-rate transfer can reduce the cost of training large language models: instead of sweeping learning rates at target scale, practitioners extrap