Rethinking Self-Distillation for Multi-Teacher Capability Merging
DGX agentarXiv:2610.04272v1 Announce Type: new Abstract: Combining capabilities of multiple expert models trained starting from the same base checkpoint has become increasingly common in frontier language-mode