RADS: Reinforcement Learning-Based Sample Selection Improves Transfer Learning in Low-resource and Imbalanced Clinical Settings

arXiv:2604.20256v1 Announce Type: new Abstract: A common strategy in transfer learning is few shot fine-tuning, but its success is highly dependent on the quality of samples selected as training examples. Active learning methods such as uncertainty sampling and diversity sampling can select useful samples. However, under extremely low-resource and class-imbalanced conditions, they often favor outliers rather than truly informative samples, resulting in degraded performance. In this paper, we introduce RADS (Reinforcement Adaptive Domain Sampling), a robust sample selection strategy using reinforcement learning (RL) to identify the most informative samples. Experimental evaluations on several real world clinical datasets show our sample selection strategy enhances model transferability while maintaining robust performance under extreme class imbalance compared to traditional methods.

Related

• HopRank: Self-Supervised LLM Preference-Tuning on Graphs for Few-Shot Node Classification
• Domain Fine-Tuning FinBERT on Finnish Histopathological Reports: Train-Time Signals and Downstream Correlations
• Learning from Less: Measuring the Effectiveness of RLVR in Low Data and Compute Regimes
• Learning Preference-Based Objectives from Clinical Narratives for Sequential Treatment Decision-Making

Source: arXiv cs.CL | 2026-04-23