Likelihood-free inference with nuisance parameters through normalizing flows

arXiv:2609.10534v1 Announce Type: cross Abstract: We present a simple decomposition of a neural-network-based normalizing flow that naturally uncovers a pivotal statistic (or something close) in the presence of nuisance parameters, based only on a sample generator from the distribution of interest. We show that the statistic is near-pivotal in the sense of minimum average KL-divergence of its p-values versus uniform and we argue that it can be expected to have good power when the dimension of the statistic equals the dimension of the parameter. It is able to incorporate prior knowledge about group invariances such as translation and scale. It can discover the one-sample t-test almost exactly, outperforms the Welch test in terms of worst-case size over a constrained variance-ratio range and achieves good calibration on partial biserial correlations, while showing higher power (and being much faster) on small-to-moderate samples than profile likelihood-ratio techniques.

Related

• Amortized Inference of Multi-Modal Posteriors using Likelihood-Weighted Normalizing Flows
• Simulation-based parameter estimation via a combination of embedded normalizing flows and implied empirical probabilities under moment restrictions
• Neural Galerkin Normalizing Flows for Bayesian Inference of Diffusions with Inaccessible Boundaries

Source: arXiv cs.LG | 2026-09-10