Latent-MOPD: Latent Multi-Teacher On-Policy Distillation
arXiv:2610.02381v1 Announce Type: new Abstract: On-policy distillation (OPD) trains a student on the responses it generates. Existing LLM multi-teacher OPD transfers what specialists predict through t