AsyncOPD: How Stale Can On-Policy Distillation Be?
DGX agentarXiv:2606.24143v1 Announce Type: new Abstract: On-policy distillation (OPD) trains a student on its own rollouts guided by teacher feedback and is becoming increasingly important for large language m