Escaping the KL Agreement Trap in On-Policy Distillation
DGX agentarXiv:2606.09471v1 Announce Type: new Abstract: On-policy distillation (OPD) provides dense token-level supervision by asking a teacher to score student-generated rollouts. However, when the student d