Disentangling Self-Distillation: Measuring and Modeling Acquisition and Retention
DGX agentarXiv:2609.39494v1 Announce Type: new Abstract: Self-distillation with privileged context adapts a language model from demonstrations by letting the model, once conditioned on a reference response, te