Distill on a Diet: Efficient Knowledge Distillation via Learnable Data Pruning
arXiv:2606.25488v1 Announce Type: new Abstract: Knowledge Distillation (KD) is widely used to obtain compact models for efficient inference in resource-constrained environments. Yet the computational