Synergistic Information Disentanglement for Omni-modal Slide Representation Learning in Computational Pathology

arXiv:2609.02118v1 Announce Type: new Abstract: In computational pathology (CPath), developing omni-modal self-supervised learning (SSL) models that integrate histology, genomics, and clinical reports enables transferable representation learning for whole slide images (WSIs). Existing approaches implicitly force heterogeneous modalities into a uniform latent space by contrastive alignment, causing modality collapse where unique, synergistic diagnostic signals (termed as Phi) are discarded in favor of trivial redundancy. We hypothesize that the strongest task-agnostic SSL training signal stems from distilling the synergistic interactions over merely aligning shared redundancy. To this end, we introduce extsc{Phi-Omni}, a synergistic information disentanglement framework grounded in Partial Information Decomposition (PID) theory for slide representation learning. Unlike standard contrastive approaches, extsc{Phi-Omni} employs a Synergistic Information Bottleneck (SIB) regulated by the proposed Phiext{ID} objective, which explicitly suppresses marginal redundancy while maximizing irreducible synergy, thereby distilling high-order cross-modal interactions. Following pretraining on breast (n=1031) and lung (n=919) cohorts, extsc{Phi-Omni} demonstrates superior few-shot performance across five independent external datasets spanning eight tasks compared to supervised and SSL baselines. Source code is available here.

Source: arXiv cs.CV | 2026-09-03