Better Supervision Is Nearby: Neighborhood On-Policy Self-Distillation
DGX agentarXiv:2609.39687v1 Announce Type: new Abstract: On-policy self-distillation (OPSD) trains mathematical reasoning models using a privileged teacher that sees a reference solution and supervises student