OPMD: On-Policy Mechanism Distillation Beyond Output Supervision
DGX agentarXiv:2610.14022v1 Announce Type: new Abstract: On-policy distillation (OPD) improves language-model by supervising a student on prefixes sampled from its own policy, but its supervision remains confi