mupscaling small models: Principled warm starts and hyperparameter transfer
DGX agentarXiv:2602.10545v2 Announce Type: replace-cross Abstract: Modern large-scale neural networks are often trained and released in multiple sizes to accommodate diverse inference budgets. To improve effic