Bayesian Inverse Transition Learning: Learning Dynamics From Near-Optimal Trajectories

arXiv:2411.05174v2 Announce Type: replace Abstract: We consider the problem of estimating the transition dynamics T^* from near-optimal expert trajectories in the context of offline model-based reinforcement learning. We develop a novel constraint-based method, Inverse Transition Learning, that treats the limited coverage of the expert trajectories as a feature: we use the fact that the expert is near-optimal to inform our estimate of T^*. We integrate our constraints into a Bayesian approach. Across both synthetic environments and real healthcare scenarios like Intensive Care Unit (ICU) patient management in hypotension, we demonstrate not only significant improvements in decision-making, but that our posterior can inform when transfer will be successful.

Model-Based Reinforcement Learning under Random Observation Delays
Variational Grey-Box Dynamics Matching
Interpretable Relational Inference with LLM-Guided Symbolic Dynamics Modeling
Learning Dynamics from Input-Output Data with Hamiltonian Gaussian Processes
Energy-based Regularization for Learning Residual Dynamics in Neural MPC for Omnidirectional Aerial Robots

Source: arXiv cs.LG | 2026-04-29

Related