Progressive^2: A Teacher-Student Progressive Co-Evolving Knowledge Distillation Method for Substantial Model Compression
DGX agentarXiv:2608.00129v1 Announce Type: new Abstract: Knowledge distillation (KD) is a widely utilized technique for transferring knowledge from a large model (the teacher) to a smaller model (the student).