Tutorials
Which CS1 Students Will Fail? Identifying Digital Markers from Learning Analytics in Computer Systems and Architecture Using Weighted Academic Momentum and Interaction Logs
arXiv:2608.16914v1 Announce Type: cross Abstract: Digital learning platforms generate rich behavioural traces (digital markers) that offer the potential to identify struggling students early. This pap
arXiv:2608.16914v1 Announce Type: cross Abstract: Digital learning platforms generate rich behavioural traces (digital markers) that offer the potential to identify struggling students early. This paper investigates whether a combination of traditional and digital markers can predict failure in a first-year CS1 course (Computer Systems and Architecture) with sufficient recall to enable timely intervention. Using data from four cohorts (2017-2021, N=284) at a large public university in sub-Saharan Africa, we conducted a mixed-methods stakeholder elicitation to identify ten candidate factors. These were operationalised into a comprehensive feature set spanning demographics, self-reported surveys, Moodle interaction logs, and continuous assessment scores. A systematic ablation study using logistic regression with 5-fold cross-validation and SMOTE+ENN resampling revealed that the most predictive feature subset was Base + Demo + LMS: weighted academic momentum (M = 0.1Q1 + 0.15Q2 + 0.2Q3 + 0.55T1), basic demographics (gender, sponsorship, COVID-19 cohort), and a binary indicator of any LMS activity. On a held-out test set, logistic regression achieved 74.7% accuracy, 0.742 macro F1, and an AUC of 0.800. At the default threshold of 0.5, the model identified 87% of failing students (recall = 0.87) with a 41% false positive rate. SHAP analysis confirmed that weighted academic momentum is the strongest predictor, followed by its interaction with LMS engagement. These results demonstrate that simple digital markers can power a practical early-warning system by the fifth week of the semester. Our main contributions are: (1) a multi-source dataset and a stakeholder-guided methodology; (2) an ablation study quantifying feature group contributions; and (3) an interpretable, high-recall model ready for deployment.
Related
- Cross-Course Generalizability of SRL-Aligned Predictive Models Using Digital Learning Traces
- Modeling Student Learning with 3.8 Million Program Traces
- Distribution Shift in Missing Data Imputation: A Risk-Based Perspective and Importance-Weighted Correction under MAR
Source: arXiv cs.LG | 2026-08-19