CrossFlowDG: Bridging the Modality Gap with Cross-modal Flow Matching for Domain Generalization

arXiv:2604.16892v1 Announce Type: new Abstract: Domain generalization (DG) aims to maintain performance under domain shift, which in computer vision appears primarily as stylistic variations that cause models to overfit to domain-specific appearance cues rather than class semantics. To overcome this, recent methods use textual representations as stable, domain-invariant anchors. However, multimodal approaches that rely on cosine similarity-based contrastive alignment leave a modality gap where image and text embeddings remain geometrically separated despite semantic correspondence. We propose CrossFlowDG, a novel DG framework that addresses this residual gap using noise-free, cross-modal flow matching. By learning a continuous transformation in the joint Euclidean latent space, our framework explicitly transports domain-biased image embeddings toward domain-invariant text embeddings of the correct class. Using the efficient VMamba image encoder and CLIP's text encoder, CrossFlowDG is tested against four common DG benchmarks, and achieves competitive performance on several benchmarks and state-of-the-art on TerraIncognita. Code is available at: https://github.com/ajkrit/CrossFlowDG

Related

• PEPR: Privileged Event-based Predictive Regularization for Domain Generalization
• DecAlign: Hierarchical Cross-Modal Alignment for Decoupled Multimodal Representation Learning
• Inside-Out: Measuring Generalization in Vision Transformers Through Inner Workings
• FGML-DG: Feynman-Inspired Cognitive Science Paradigm for Cross-Domain Medical Image Segmentation
• Back into Plato's Cave: Examining Cross-modal Representational Convergence at Scale

Source: arXiv cs.CV | 2026-04-21