When Explanations Compete: Policy-Aware Selection Under Uncertainty

arXiv:2410.05479v2 Announce Type: replace Abstract: Uncertainty-aware explanation methods often produce several alternatives for the same prediction. Selecting among them requires a policy for balancing prediction confidence, uncertainty, and application constraints. This paper presents a framework for applying such policies to a fixed set of generated explanations. Candidates are characterised by uncertainty change, prediction direction, and, when available, interval position relative to a decision boundary. The framework combines these properties with eligibility rules, optional bidirectional Pareto screening, and policy-aware ranking. A fictitious prostate-cancer example illustrates how different explanatory purposes lead to different selections from the same candidate set. We instantiate the framework with Calibrated Explanations for classification, thresholded regression, and plain regression. Across 41 benchmark datasets, mean candidate counts range from 11.57 to 21.75 for single-feature explanations and from 29.48 to 69.53 when conjunctions are included. Equal-weight and confidence-only policies yield an average selection-disagreement rate of 28.7% while favouring the same confidence direction. A supporting elta-CLUE experiment demonstrates use with a second generator. By making the selection policy explicit, the framework allows applications to compare and prioritise explanations according to their intended use.

Related

• Informative Perturbation Selection for Uncertainty-Aware Post-hoc Explanations
• When Agents Disagree With Themselves: Behavioral Consistency as an Uncertainty Signal for LLM Agents
• Structured Uncertainty guided Clarification for LLM Agents

Source: arXiv cs.AI | 2026-10-07