Towards Bridging the Gap Between Offline and Iterative Alignment via Preference Distillation
DGX agentarXiv:2609.06893v1 Announce Type: cross Abstract: Direct preference optimization DPO is a promising offline approach for aligning large language models (LLMs) due to its simplicity, computational effi