Matching Supervision to the Student's Learning Capacity: A Unified Framework for On-Policy Self-Distillation
arXiv:2608.08176v1 Announce Type: new Abstract: On-policy self-distillation (OPSD) improves the reasoning abilities of LLMs by internalizing privileged context into model parameters through self-disti