Rethinking Privileged Information in On-Policy Self-Distillation
DGX agentarXiv:2608.18271v1 Announce Type: new Abstract: On-policy self-distillation (OPSD) trains a student on its own responses using token-level supervision from the same model conditioned on privileged ref