One Symptom, Three Levers: A Critical Review of On-Policy Self-Distillation
arXiv:2608.25936v1 Announce Type: cross Abstract: On-policy distillation trains a language model on its own generations while a teacher scores them token by token. It combines the dense supervision of