Data Selection for Multi-turn Dialogue Instruction Tuning

arXiv:2604.07892v1 Announce Type: new Abstract: Instruction-tuned language models increasingly rely on large multi-turn dialogue corpora, but these datasets are often noisy and structurally inconsistent, with topic drift, repetitive chitchat, and mismatched answer formats across turns. We address this from a data selection perspective and propose extbf{MDS} (Multi-turn Dialogue Selection), a dialogue-level framework that scores whole conversations rather than isolated turns. MDS combines a global coverage stage that performs bin-wise selection in the user-query trajectory space to retain representative yet non-redundant dialogues, with a local structural stage that evaluates within-dialogue reliability through entity-grounded topic grounding and information progress, together with query-answer form consistency for functional alignment. MDS outperforms strong single-turn selectors, dialogue-level LLM scorers, and heuristic baselines on three multi-turn benchmarks and an in-domain Banking test set, achieving the best overall rank across reference-free and reference-based metrics, and is more robust on long conversations under the same training budget. Code and resources are included in the supplementary materials.

Related

• DYCP: Dynamic Context Pruning for Long-Form Dialogue with LLMs
• Rethinking Data Mixing from the Perspective of Large Language Models
• Cram Less to Fit More: Training Data Pruning Improves Memorization of Facts
• EventWeave: A Dynamic Framework for Capturing Core and Supporting Events in Dialogue Systems
• Stop Listening to Me! How Multi-turn Conversations Can Degrade LLM Diagnostic Reasoning

Source: arXiv cs.CL | 2026-04-10