DiscoTrace: Representing and Comparing Answering Strategies of Humans and LLMs in Information-Seeking Question Answering

arXiv:2604.15140v1 Announce Type: new Abstract: We introduce DiscoTrace, a method to identify the rhetorical strategies that answerers use when responding to information-seeking questions. DiscoTrace represents answers as a sequence of question-related discourse acts paired with interpretations of the original question, annotated on top of rhetorical structure theory parses. Applying DiscoTrace to answers from nine different human communities reveals that communities have diverse preferences for answer construction. In contrast, LLMs do not exhibit rhetorical diversity in their answers, even when prompted to mimic specific human community answering guidelines. LLMs also systematically opt for breadth, addressing interpretations of questions that human answerers choose not to address. Our findings can guide the development of pragmatic LLM answerers that consider a range of strategies informed by context in QA.

Interpretable Stylistic Variation in Human and LLM Writing Across Genres, Models, and Decoding Strategies
TEC: A Collection of Human Trial-and-error Trajectories for Problem Solving
Generating Effective CoT Traces for Mitigating Causal Hallucination
How to Fine-Tune a Reasoning Model? A Teacher-Student Cooperation Framework to Synthesize Student-Consistent SFT Data
From Procedural Skills to Strategy Genes: Towards Experience-Driven Test-Time Evolution

Source: arXiv cs.CL | 2026-04-17

Related