Masking Frequent Tokens Sharpens Direct Preference Optimization
DGX agentarXiv:2609.32445v1 Announce Type: cross Abstract: Direct Preference Optimization (DPO) aligns language models by optimizing over sequence-level sums of token-wise implicit reward differences. However,