Good Pretraining, Bad SFT: Checkpoint Quality Across the Training Stack
DGX agentarXiv:2609.08966v1 Announce Type: new Abstract: Language-model checkpoints are commonly selected by pretraining loss or benchmark scores, assuming that the highest-scoring checkpoint will remain the b