Terminal Shrinkage Averaging Reveals a Schedule-Estimator Interaction in LLM Pretraining
DGX agentarXiv:2609.25482v1 Announce Type: new Abstract: Large language model (LLM) pretraining conventionally returns the raw final iterate. This couples two design choices: the learning-rate schedule that ge