Learnable Motion-Focused Tokenization for Effective and Efficient Video Unsupervised Domain Adaptation

arXiv:2604.09955v1 Announce Type: new Abstract: Video Unsupervised Domain Adaptation (VUDA) poses a significant challenge in action recognition, requiring the adaptation of a model from a labeled source domain to an unlabeled target domain. Despite recent advances, existing VUDA methods often fall short of fully supervised performance, a key reason being the prevalence of static and uninformative backgrounds that exacerbate domain shifts. Additionally, prior approaches largely overlook computational efficiency, limiting real-world adoption. To address these issues, we propose Learnable Motion-Focused Tokenization (LMFT) for VUDA. LMFT tokenizes video frames into patch tokens and learns to discard low-motion, redundant tokens, primarily corresponding to background regions, while retaining motion-rich, action-relevant tokens for adaptation. Extensive experiments on three standard VUDA benchmarks across 21 domain adaptation settings show that our VUDA framework with LMFT achieves state-of-the-art performance while significantly reducing computational overhead. LMFT thus enables VUDA that is both effective and computationally efficient.

Related

• Efficient Spatial-Temporal Focal Adapter with SSM for Temporal Action Detection
• Bootstrapping Video Semantic Segmentation Model via Distillation-assisted Test-Time Adaptation
• Inferring Dynamic Physical Properties from Video Foundation Models
• Mitigating Domain Drift in Multi Species Segmentation with DINOv2: A Cross-Domain Evaluation in Herbicide Research Trials
• DoSReMC: Domain Shift Resilient Mammography Classification using Batch Normalization Adaptation

Source: arXiv cs.CV | 2026-04-14