Disentangling Optimization Scale from Preference Scale in DPO
DGX agentarXiv:2608.27032v1 Announce Type: new Abstract: Direct Preference Optimization (DPO) is a widely used objective for aligning language models from preference data, with the coefficient eta commonly int