DAP-Pose: Deep Temporal Alignment and Physics-aware Cross-modal Sensor Fusion for Robust Pose Estimation

arXiv:2607.23755v1 Announce Type: new Abstract: Robust and accurate pose estimation with multi-modal sensors is fundamental for autonomous vehicles and mobile robotic systems in complex environments. In this paper, we propose DAP-Pose, a unified end-to-end model for robust multi-modal pose estimation. DAP-Pose introduces a Bi-level Cross-modal Fusion (BCF) module that captures complementary semantic and geometric motion cues from visual, inertial, and GNSS measurements. To handle temporal offsets, we designed a Deep Temporal Alignment (DTA) module that explicitly aligns asynchronous streams in latent space, enabling coherent motion modeling without strict hardware synchronization. Furthermore, we incorporate physics-aware constraints via manifold geometry and GNSS-guided absolute metric scale, enforcing motion consistency and mitigating drift. Experiments upon the public KITTI benchmark dataset were conducted to evaluate the performance of DAP-Pose against existing methods. DAP-Pose achieved the state-of-the-art performance, with the lowest average translation error (t_{rel}) of 1.31% and rotation error (r_{rel}) of 0.46^{irc}. Furthermore, it accurately estimates poses and maintains robust performance under severe artificially injected temporal misalignment.

Related

• Efficient Minimal Solvers for Visual-Inertial Relative Pose Estimation in Multi-Camera Systems
• Efficient Minimal Solvers for Relative Pose Estimation in Autonomous Driving Applications
• MAPRPose: Mask-Aware Proposal and Amodal Refinement for Multi-Object 6D Pose Estimation
• RRTrack: Robust and Recoverable Object 6D Pose Tracking for Dynamic Scenes

Source: arXiv cs.CV | 2026-07-28