Condition-Contrastive Extrapolation for On-Policy Distillation of Language Models
DGX agentarXiv:2610.21195v1 Announce Type: new Abstract: On-policy distillation (OPD) improves a student language model by training on its own generated trajectories with supervision from a stronger teacher. H