REVO: Rollout-Efficient Off-Policy Distillation via Variance-Guided Reuse
arXiv:2609.37500v1 Announce Type: new Abstract: On-policy distillation (OPD) trains language models using dense token-level teacher supervision on student-generated trajectories. However, its reliance