Loss-Driven Bayesian Active Learning

arXiv:2604.11995v1 Announce Type: new Abstract: The central goal of active learning is to gather data that maximises downstream predictive performance, but popular approaches have limited flexibility in customising this data acquisition to different downstream problems and losses. We propose a rigorous loss-driven approach to Bayesian active learning that allows data acquisition to directly target the loss associated with a given decision problem. In particular, we show how any loss can be used to derive a unique objective for optimal data acquisition. Critically, we then show that any loss taking the form of a weighted Bregman divergence permits analytic computation of a central component of its corresponding objective, making the approach applicable in practice. In regression and classification experiments with a range of different losses, we find our approach reduces test losses relative to existing techniques.

Positive-Unlabelled Active Learning to Curate a Dataset for Orca Resident Interpretation
Differentially Private and Federated Structure Learning in Bayesian Networks
Active Bayesian Inference for Robust Control under Sensor False Data Injection Attacks
PAC-Bayesian Bounds on Constrained f-Entropic Risk Measures
Active Statistical Inference
A Bayesian Perspective on the Role of Epistemic Uncertainty for Delayed Generalization in In-Context Learning

Source: arXiv cs.LG | 2026-04-15

Related