Responsiveness Verification: Will Predictions Change? How Much? How Often?

arXiv:2507.02169v2 Announce Type: replace Abstract: Machine learning models are often used in applications where their inputs change due to routine interactions, strategic manipulation, or noise. In such settings, models can undermine safety as these changes lead them to predict over regions of input space they have not seen. We propose to address these challenges by measuring responsiveness---the probability that a model output changes when its inputs change under an interaction model. We develop algorithms to estimate responsiveness for any machine learning model, and a framework to specify broad classes of interaction models. We pair these algorithms with statistical guarantees that support practical validation. We demonstrate how our tools can promote safety and reliability across domains by detecting preclusion in recidivism prediction, estimating the cost of gaming in content moderation, and testing the robustness of benchmarks for LLMs.

Related

• AOE: Exhaustive Out-of-Distribution Detection via Recalibrating Outlier Labels
• Not Just How Much, But Where: Decomposing Epistemic Uncertainty into Per-Class Contributions
• Worst-Case Distance-Aware Error Bounds for Neural Networks

Source: arXiv cs.LG | 2026-08-17