metasignal: A Python Package for Comprehensive Metacognitive Analysis and Decision-Making

arXiv:2607.29093v1 Announce Type: cross Abstract: Metasignal is an open-source Python package for signal detection theory (SDT) and metacognitive measurement. It implements the 17 metacognitive measures evaluated by Rahnev (2025), together with the reference variables d' (perceptual sensitivity), response criterion c (response bias), and mean confidence. The 17 measures comprise three meta-d' family estimates, meta-d', M-ratio, and M-difference; four nonparametric Type-2 measures, the Type-2 area under the receiver-operating-characteristic curve (AUC2), Gamma, Phi, and delta confidence, together with their eight SDT-normalized ratio and difference forms; and two model-based measures, meta-noise and meta-uncertainty. A single function computes the complete set from trial-level stimulus, response, and confidence arrays. metasignal currently supports binary (two-alternative) discrimination tasks, in which each trial's stimulus and response are coded with exactly two categories. The package also provides a command-line interface, group summaries, bootstrap confidence intervals, permutation tests, optional hierarchical Bayesian models, and information-theoretic measures. metasignal unifies these measures in a single platform to encourage broader metacognition research and adoption in decision-making studies.

Related

• Annotator Positionality as Signal: Psychometric Weighting for Anti-Autistic Ableism Detection
• Learning When Not to Learn: Risk-Sensitive Abstention in Bandits with Unbounded Rewards
• The Confidence Trap: Calibration Attacks for Graph Neural Networks

Source: arXiv cs.AI | 2026-08-03