Safety
Responsible Institutional Analytics: Interpreting Bias with AI Support
arXiv:2610.07205v1 Announce Type: cross Abstract: Institutional Analytics (IA) dashboards inform decision-making in higher education, yet data limitations, constraints in analytical techniques, and mi
arXiv:2610.07205v1 Announce Type: cross Abstract: Institutional Analytics (IA) dashboards inform decision-making in higher education, yet data limitations, constraints in analytical techniques, and missing contextual information often affect their interpretation. To support more responsible interpretation of IA, we introduce FACTRIA, a framework that organizes potential biasing factors across four areas: the analytics pipeline, institutional context, course-level characteristics, and demographics. We used the FACTRIA framework as input to a generative-AI chatbot designed to prompt users to reflect on these factors while analyzing IA. A qualitative study with stakeholders, drawing on four authentic IA cases, and a transition network analysis showed that the chatbot prompted participants to recognize how overlooked factors influenced their initial interpretation. Findings indicated that combining a structured framework with AI-based guidance can enhance context-aware, responsible interpretation of institutional data.
Related
- Exploring the impact of fairness-aware criteria in AutoML
- Practitioner Beliefs and Behaviors in AI-Enhanced Education: DOT Framework Survey Evidence
- Selective Prediction Reduces the Negative Effects of Automation Bias Overall but Increases False Negatives
Source: arXiv cs.AI | 2026-10-07