Distillation as Probability Transport: Routed On-Policy Distillation
DGX agentarXiv:2609.08337v1 Announce Type: new Abstract: On-policy distillation (OPD) transfers teacher knowledge on student-generated trajectories, but efficient sampled objectives reduce the teacher distribu