Applications

Statistical Matching via Schrodinger Bridge beyond Conditional Independence

arXiv:2606.22770v1 Announce Type: new Abstract: Statistical matching combines partially overlapping datasets that share covariates X but observe the target Y and auxiliary variables Z separately. Clas

DGX agentpaper
applicationsarxiv-cs-lg

arXiv:2606.22770v1 Announce Type: new Abstract: Statistical matching combines partially overlapping datasets that share covariates X but observe the target Y and auxiliary variables Z separately. Classical approaches typically invoke the conditional independence assumption (CIA), which makes the problem identifiable but fundamentally implies that the imported auxiliary variable provides no additional predictive power for Y once X is known. To capture this latent Y--Z dependence, we propose a novel dependency-aware Schrodinger bridge for predictive statistical matching. Our approach couples the two separated databases by tilting the conservative CIA baseline with a transportation-based compatibility cost, recovering an informative joint distribution. The resulting statistical learning framework yields full probabilistic posterior rules for bidirectional imputation. Theoretically, we establish a sufficient condition under which the learned bridge strictly improves over the CIA baseline, alongside an exact joint recovery guarantee in the Gaussian setting under an appropriate cost. Across synthetic benchmarks and real-world datasets (CelebA and Adult), we demonstrate that our dependency-aware completion consistently improves downstream predictive utility, proving especially beneficial in settings like data recoding where the underlying population exhibits strong Y--Z dependence.

Source: arXiv cs.LG | 2026-06-23

Loading related sources…