ConfAL-WM: Confidence-Guided Active Learning for Action-Conditioned World Models

arXiv:2608.25572v1 Announce Type: new Abstract: Action-conditioned world models have become an important foundation for embodied prediction, planning, and synthetic data generation, but their errors under new task and scene distributions are often concentrated in localized spatiotemporal regions such as robot arms, manipulated objects, contact areas, and occluded objects. This paper presents ConfAL-WM, a confidence-guided active learning framework for post-training embodied world models. Built upon EVAC, we attach a lightweight confidence probe to UNet decoder features and predict dense confidence maps in the latent space. These maps are aggregated into task-, frame-, and patch-level scores, enabling both efficient data selection and localized training enhancement. Our pipeline first retrains the confidence probe and warms up EVAC with a small subset of target-domain data, then performs task-level prescreening to allocate sampling budgets, and finally applies selected-data retraining with optional frame or patch weighted data enhancement. Experiments on RoboTwin2.0 show that confidence-guided selection improves post-training efficiency, while dense frame and patch weighting further enhances prediction quality and embodied trajectory consistency compared with scalar reward, progress, and judge-based scoring baselines. A quick visual overview of this work is available at https://ConfAL-WM.github.io.

Related

• ACID: Action Consistency via Inverse Dynamics for Planning with World Models
• Privileged Foresight Distillation: Zero-Cost Future Correction for World Action Models
• SIEVE: Structure-Aware Data Selection for Imitation Learning with VLA Models
• CLAW: Learning Continuous Latent Action World Models via Adversarial Latent Regularization

Source: arXiv cs.RO | 2026-08-27