RL-PaO: Prediction as Action in Decision Making under Uncertainty

arXiv:2609.37065v1 Announce Type: new Abstract: Decision-making under uncertainty often relies on predicted parameters, yet accurate prediction does not necessarily lead to good operational decisions. Aligning prediction with downstream optimization requires learning from the consequences of the decisions those predictions induce. We introduce RL-PaO, a reinforcement learning framework that integrates system formulation, optimization, and decision execution into a single environment. This yields a Markov decision process in which prediction is regarded as action: it shifts the environment to produce subsequent context and reward that explicitly aligns prediction error with realized cost, and learning the optimal policy does not require differentiating through the black-box solver. We evaluate RL-PaO on day-ahead energy scheduling using real historical data. On the test year, RL-PaO achieves the lowest annual cost among the non-oracle baselines, achieving on average 10% cost reduction. Moreover, RL-PaO is capable of further analyses to provide strong interpretability both from the policy evolution perspective and the cost-accuracy trade-off.

Related

• Not All Errors Matter: Decision-Relevant Prediction Error Predicts Planning Quality
• When to Commit and When to Defer: Maturing Markov Decision Processes under Refining Information and Expiring Opportunities
• Optimizing Minimax Regret in Uncertain MDPs with Small Sets of Policies
• Online Conformal Prediction with Adversarial Semi-bandit Feedback via Regret Minimization
• The Value of Mechanistic Priors in Sequential Decision Making

Source: arXiv cs.LG | 2026-09-30