PAIR-Former: Budgeted Relational Multi-Instance Learning for Functional miRNA Target Prediction

arXiv:2602.00465v3 Announce Type: replace-cross Abstract: Functional miRNA--mRNA targeting is a large-bag prediction problem where each transcript yields a heavy-tailed pool of candidate target sites (CTSs), yet only a pair-level label is observed. Prior methods use max-pooling over individual CTS scores, ignoring relational patterns among sites, but modeling these patterns is critical for accuracy. The challenge is that naive relational aggregation incurs O(n^2) cost, prohibitive when n reaches thousands, yet a cheap scan alone discards the very interactions that drive functional repression. We formalize this tension as Budgeted Relational Multi-Instance Learning (BR-MIL), a new MIL problem where the compute budget K is a first-class constraint such that at most K instances per bag may receive expensive encoding and relational processing. We establish theoretical foundations for BR-MIL, proving that both approximation quality and generalization are governed by K rather than the raw bag size n. Building on this theory, we propose extbf{PAIR-Former}, which scans all candidates cheaply, selects K diverse CTSs, and aggregates them via Set Transformer. PAIR-Former achieves state-of-the-art performance, outperforming all reproduced baselines with F1=0.840 on miRAW (10-fold balanced CV) and 0.839 on deepTargetPro in transfer evaluation, while achieving 0.793 on the large-scale MTI benchmark (420K pairs, 38imes larger), demonstrating that budgeted relational MIL scales where naive approaches fail. Additional results on CAMELYON16 and Musk2 further show that the proposed BR-MIL formulation extends beyond biological sequence modeling.

Source: arXiv cs.AI | 2026-05-11