Smaller Models, Better Rejects: Preference Distillation Scaling
DGX agentarXiv:2609.38987v1 Announce Type: new Abstract: Preference distillation typically treats a teacher response as preferred and the student's own response as rejected. This assumes that self-generated fa