Ensemble Controlled-Flow Filtering for Implicit Data Assimilation

arXiv:2607.12975v1 Announce Type: cross Abstract: Data assimilation estimates the state of a dynamical system from model forecasts and incoming observations. Many observation mechanisms, however, are many-to-one, implicit, non-smooth, or accessible only through simulation, and need not provide the residual structures or likelihood guidance required by existing ensemble filters. We introduce implicit data assimilation, in which the analysis law is defined as an energy tilt of the forecast distribution. We then propose the Ensemble Controlled-flow Filter (EnCF), which realizes this update through a stochastic controlled flow and learns the observation-dependent control by adjoint matching from terminal energy gradients. For simulator-defined observations, EnCF-LF learns a surrogate conditional energy from samples and applies the same controlled-flow solver. We prove ideal exactness, derive a one-step error decomposition, and establish non-accumulation of local errors under filter stability. Numerical results show that Kalman-type filters remain preferable for smooth additive-Gaussian observations, while the proposed methods are better suited to non-Gaussian, many-to-one, multimodal, and implicit observation models.

Related

• Flow Matching for Efficient and Scalable Data Assimilation
• Coupling-Informed Transport Maps for Bayesian Filtering in Nonlinear Dynamical Systems
• The Ensemble Schr{odinger Bridge filter for Nonlinear Data Assimilation
• DAISI: Data Assimilation with Inverse Sampling using Stochastic Interpolants
• Training-Free Bayesian Filtering with Generative Emulators

Source: arXiv cs.LG | 2026-07-15