Beyond the Model: The Critical Role of Data Filtering in Clinical Machine Learning

arXiv:2610.06640v1 Announce Type: new Abstract: Machine learning (ML) studies using clinical data often rely on preprocessing and filtering pipelines before model development. The filtering decisions made in these pipelines can alter the dataset's statistical structure and may artificially reduce or increase the complexity of the prediction task. We argue that filtering choices should be treated as part of the scientific method rather than as a routine preprocessing step. We further discuss the need for explainable and transparent preprocessing pipelines that allow researchers to understand why specific filtering choices are made and how these choices affect the resulting data distribution and model performance. All of the source code for this work is available on GitHub.

Related

• Interpretable Machine Learning for Antepartum Prediction of Pregnancy-Associated Thrombotic Microangiopathy Using Routine Longitudinal Laboratory Data
• PrivaDE: Privacy-preserving Data Evaluation for Blockchain-based Data Marketplaces
• Cross-cohort TB classification using clinical data gathered in Uganda and South Africa
• Exploring the Impact of Dataset Statistical Effect Size on Model Performance and Data Sample Size Sufficiency

Source: arXiv cs.LG | 2026-10-06