Collaborative Personalized Preference Alignment for LLMs under Data Deficiency
arXiv:2610.05898v1 Announce Type: new Abstract: Real-world users often exhibit highly heterogeneous preferences over multiple objectives for LLM responses. A lightweight aligner can tailor these respo