On-Policy Self-Distillation with Sampled Demonstrations Reduces Output Diversity
DGX agentarXiv:2606.26091v1 Announce Type: new Abstract: On-policy self-distillation achieves strong pass@1 accuracy by using a single model as both teacher and student, with the teacher conditioned on a corre