Differential Privacy Protected Preference Alignment on Survey Derived Data
DGX agentarXiv:2610.16458v1 Announce Type: cross Abstract: Preference alignment enables language models to better reflect human values, but the preference data contains sensitive information, especially when d