DGPO: Beyond Pairwise Preferences with Directional Consistent Groupwise Optimization
arXiv:2605.10863v1 Announce Type: new Abstract: Although Large Language Models (LLMs) have made remarkable progress, current preference optimization methods still struggle to align directional consist