How Should Teachers Be Prepared? RL on Student-Induced States for On-Policy Distillation
arXiv:2610.04950v1 Announce Type: new Abstract: On-policy distillation (OPD) improves the reasoning capabilities of small language models through token-level teacher supervision on student-generated t