How Learning Rate Decay Wastes Your Best Data in Curriculum-Based LLM Pretraining
DGX agentarXiv:2511.18903v2 Announce Type: replace-cross Abstract: Due to the scarcity of high-quality data, large language models (LLMs) are often trained on mixtures of data with varying quality levels, even