Applications
Enhancing knowledge tracing robustness for new question cold start in Intelligent Tutoring Systems
arXiv:2512.07179v2 Announce Type: replace Abstract: Intelligent Tutoring Systems (ITS) provide personalized learning paths by diagnosing learners' proficiency. Knowledge Tracing (KT) models play a cen
arXiv:2512.07179v2 Announce Type: replace Abstract: Intelligent Tutoring Systems (ITS) provide personalized learning paths by diagnosing learners' proficiency. Knowledge Tracing (KT) models play a central role in this diagnosis by estimating learners' evolving knowledge states. However, in real-world ITS services, diagnostic reliability may decrease when newly introduced questions have no prior interaction history. This study aims to empirically identify the key features that support KT model robustness under the question cold start situation. To this end, we designed Practical Integrated Cross-consistent Knowledge Tracing (PICKT), which integrates multiple types of features, and examined which feature contributes to robustness under the question cold start situation. Among these features, we further analyzed difficulty, texts, and relational information derived from the knowledge map, which have been identified as important factors in prior KT research, to examine how each contributes to robustness under the question cold start situation. The results showed that difficulty feature was particularly informative for highly challenging questions, where the likelihood of a correct response rate was remarkably low. Meanwhile, the fused texts and knowledge map features supported robustness by enabling the model to estimate the representation of unseen questions by leveraging semantically and structurally similar questions observed during training. These findings suggest that maintaining KT robustness in ITS applications requires prioritization of feature annotation aligned with the characteristics of educational services.
Related
- Faster, Cheaper, More Accurate: Specialised Knowledge Tracing Models Outperform LLMs
- SCRIPT: Implementing an Intelligent Tutoring System for Programming in a German University Context
- Failure Ontology: A Lifelong Learning Framework for Blind Spot Detection and Resilience Design
- Quantifying and Improving the Robustness of Retrieval-Augmented Language Models Against Spurious Features in Grounding Data
Source: arXiv cs.AI | 2026-09-17