Tell Me Why: Designing an Explainable LLM-based Dialogue System for Student Problem Behavior Diagnosis

arXiv:2604.22237v1 Announce Type: cross Abstract: Diagnosing student problem behaviors requires teachers to synthesize multifaceted information, identify behavioral categories, and plan intervention strategies. Although fine-tuned large language models (LLMs) can support this process through multi-turn dialogue, they rarely explain why a strategy is recommended, limiting transparency and teachers' trust. To address this issue, we present an explainable dialogue system built on a fine-tuned LLM. The system uses a hierarchical attribution method based on explainable AI (xAI) to identify dialogue evidence for each recommendation and generate a natural-language explanation based on that evidence. In technical evaluation, the method outperformed baseline approaches in identifying supporting evidence. In a preliminary user study with 22 pre-service teachers, participants who received explanations reported higher trust in the system. These findings suggest a promising direction for improving LLM explainability in educational dialogue systems.

Related

• Revisiting the Capacity Gap in Chain-of-Thought Distillation from a Practical Perspective
• Thinking in Graphs with CoMAP: A Shared Visual Workspace for Designing Project-Based Learning
• CoFEE: Reasoning Control for LLM-Based Feature Discovery
• METRO: Towards Strategy Induction from Expert Dialogue Transcripts for Non-collaborative Dialogues
• STRIDE-ED: A Strategy-Grounded Stepwise Reasoning Framework for Empathetic Dialogue Systems

Source: arXiv cs.AI | 2026-04-27