Knowledge Distillation Must Account for What It Loses
DGX agentarXiv:2604.25110v1 Announce Type: new Abstract: This position paper argues that knowledge distillation must account for what it loses: student models should be judged not only by retained task scores,