Improving LLM Interpretability with User-Centric Chain-of-Thought Reasoning

arXiv:2608.26166v1 Announce Type: cross Abstract: Advancing reasoning capabilities allow large language models (LLMs) to tackle increasingly complex problems, while reasoning traces - intermediate steps toward solutions - open up high-stakes applications by enabling human inspection of AI decision-making. However, current approaches prioritize model performance over human interpretability, limiting effective human-AI collaboration. In this study, we design and evaluate a human-centered approach that structures reasoning traces based on self-contained, verifiable steps, enabling users to independently assess and correct AI reasoning. Our approach uses XML-like tags to encode reasoning content and metadata, facilitating targeted feedback. Evaluation on mathematical reasoning tasks shows our approach maintains equivalent performance to standard Chain-of-Thought reasoning while enhancing interpretability. User studies demonstrate significant improvements in perceived usefulness and ease of use. This work advances understanding of how user-centric design of LLM outputs can better serve human collaboration needs in high-stakes AI deployments.

Related

• Deep Interaction: An Efficient Human-AI Interaction Method for Large Reasoning Models
• ChainPrune: Evaluating and Reducing Redundancy in Long Chain-of-Thought Reasoning
• Can Reasoning Path still be Effective as Input? Bridging Post-Reasoning to Chain-of-Thought Compression
• Post-Hoc Reasoning in Chain of Thought: Decoding and Steering Pre-Committed Answers
• Hidden Thoughts Are Not Secret: Reasoning Trace Exposure in LLMs

Source: arXiv cs.AI | 2026-08-28