Prompt Breadth and Rollout Refresh Interact in On-Policy Distillation
arXiv:2609.25048v1 Announce Type: new Abstract: How many prompts does on-policy distillation (OPD) need, and how does the answer depend on the student policies that generate its training responses? We