Self-Improvement Can Self-Regress: The Rise-and-Collapse Failure Mode of LLM Self-Training
DGX agentarXiv:2606.21090v1 Announce Type: cross Abstract: Self-improvement can self-regress. In REINFORCE post-training for code, a model can quickly improve on its optimized metric and then collapse within t