Leaky Students: Membership Inference against On-Policy Distillation
DGX agentarXiv:2609.33136v1 Announce Type: new Abstract: On-policy distillation (OPD) trains a student to match a teacher's next-token distributions on student-generated trajectories. However, privileged infor