scpFormer: A Foundation Model for Unified Representation and Integration of the Single-Cell Proteomics

arXiv:2604.20003v1 Announce Type: cross Abstract: The integration of single-cell proteomic data is often hindered by the fragmented nature of targeted antibody panels. To address this limitation, we introduce scpFormer, a transformer-based foundation model designed for single-cell proteomics. Pre-trained on over 390 million cells, scpFormer replaces standard index-based tokenization with a continuous, sequence-anchored approach. By combining Evolutionary Scale Modeling (ESM) with value-aware expression embeddings, it dynamically maps variable panels into a shared semantic space without artificial discretization. We demonstrate that scpFormer generates global cell representations that perform competitively in large-scale batch integration and unsupervised clustering. Moreover, its open-vocabulary architecture facilitates in silico panel expansion, assisting in the reconstruction of biological manifolds in sparse clinical datasets. Finally, this learned protein co-expression logic is transferable to bulk-omics tasks, supporting applications like cancer drug response prediction. scpFormer provides a versatile, panel-agnostic framework to facilitate scalable biomarker discovery and precision oncology.

Related

• MMCORE: MultiModal COnnection with Representation Aligned Latent Embeddings
• Distilling Genomic Models for Efficient mRNA Representation Learning via Embedding Matching
• Exascale Multi-Task Graph Foundation Models for Imbalanced, Multi-Fidelity Atomistic Data
• Large-Scale Universal Defect Generation: Foundation Models and Datasets

Source: arXiv cs.AI | 2026-04-23