From Spectra to Joint Schedules in LLM Pre-training: 3+3(+2) Scaling-Law Regimes
DGX agentarXiv:2609.40148v1 Announce Type: new Abstract: Power-law learning curves are often treated as fixed properties of a model and its data, although learning-rate and batch-size schedules can change the