Recovering Diversity Without Losing Alignment: A DPO Recipe for Post-Trained LLMs
DGX agentarXiv:2605.30021v1 Announce Type: new Abstract: Many open-ended instructions have multiple valid answers that users can benefit from seeing, but post-training often narrows an LLM's output space towar