FIRM: Federated In-client Regularized Multi-objective Alignment for Large Language Models
arXiv:2511.16992v3 Announce Type: replace Abstract: Aligning Large Language Models (LLMs) with human values often involves balancing multiple, conflicting objectives such as helpfulness and harmlessne