Heterogeneous Knowledge Distillation via Geometry Decoupling and Momentum-Aware Gradient Regulation
DGX agentarXiv:2606.24557v1 Announce Type: new Abstract: Heterogeneous Knowledge Distillation (HKD) aims to transfer knowledge across varying architectures (e.g., from Transformer to CNN) but inherently suffer