Multi-Faceted Self-Consistent Preference Alignment for Query Rewriting in Conversational Search

arXiv:2604.06771v1 Announce Type: cross Abstract: Conversational Query Rewriting (CQR) aims to rewrite ambiguous queries to achieve more efficient conversational search. Early studies have predominantly focused on the rewriting in isolation, ignoring the feedback from query rewrite, passage retrieval and response generation in the rewriting process. To address this issue, we propose Multi-Faceted Self-Consistent Preference Aligned CQR (MSPA-CQR). Specifically, we first construct self-consistent preference alignment data from three dimensions (rewriting, retrieval, and response) to generate more diverse rewritten queries. Then we propose prefix guided multi-faceted direct preference optimization to learn preference information from three different dimensions. The experimental results show that our MSPA-CQR is effective in both in- and out-of-distribution scenarios.

WebExpert: domain-aware web agents with critic-guided expert experience for high-precision search
Region-R1: Reinforcing Query-Side Region Cropping for Multi-Modal Re-Ranking
What Makes an Ideal Quote? Recommending 'Unexpected yet Rational' Quotations via Novelty
The Master Key Hypothesis: Unlocking Cross-Model Capability Transfer via Linear Subspace Alignment

Source: arXiv cs.AI | 2026-04-10

Related