Machine learning pipelines in clinical research commonly include data preprocessing steps intended to improve predictive accuracy. This study investigated whether such preprocessing materially affects ensembles built exclusively from preprocessing-invariant tree-based learners. Specifically, the authors evaluated how preprocessing influenced predictive performance, the distribution of learner weights within a Super Learner ensemble, and ensemble oracle behavior in clinical classification tasks.
Three publicly available benchmark clinical classification datasets were used:
The Super Learner library comprised four tree-based algorithms that are generally invariant to certain common preprocessing operations: Classification and Regression Trees (CART), Random Forest, Ranger, and Extreme Gradient Boosting (XGBoost). These learners were combined into a Super Learner ensemble for each dataset and preprocessing condition.
Models were evaluated under two data conditions: raw input data and preprocessed data. The manuscript does not provide additional granular details about the exact preprocessing operations applied in each case beyond referring to a preprocessed condition. All model evaluations used repeated cross-validation to assess out-of-sample predictive performance and to generate estimates for ensemble behavior under each condition.
Predictive performance was quantified using three metrics: AUC (area under the receiver operating characteristic curve), Matthews correlation coefficient (MCC), and Brier score. To compare learner weight allocations and Oracle Gaps between preprocessing conditions, the authors used paired Wilcoxon signed-rank tests with Benjamini–Hochberg adjustment for multiple testing. Oracle Gap was used to assess how closely the Super Learner approached the best-performing library learner in each condition.
Heart Disease and Pima Indians Diabetes datasets: Preprocessing produced negligible changes in predictive performance across reported metrics. The source indicates no meaningful AUC, MCC, or Brier score improvements for these two datasets after preprocessing.
Indian Liver Patient Dataset (ILPD): Preprocessing resulted in a small but statistically significant improvement in AUC, increasing from 0.746 to 0.752 (adjusted p = 0.0017). The Brier score decreased modestly from 0.177 to 0.175 with adjusted p < 0.001. The manuscript reports these as statistically significant changes, though absolute effect sizes are small.
Learner weight distributions within the Super Learner were reported to be largely stable across raw and preprocessed data conditions. An exception was observed in the Heart Disease dataset where Random Forest replaced Ranger as the dominant learner in the ensemble under one of the conditions. The authors report that Oracle Gaps remained extremely small across all datasets — less than 0.002 — and that there were no significant differences in Oracle Gap between preprocessing conditions. This suggests the Super Learner maintained oracle-like behavior regardless of preprocessing.
The findings indicate that when a Super Learner ensemble is composed exclusively of preprocessing-invariant tree-based learners, routine preprocessing may provide limited additional predictive benefit. Even when statistically significant changes were seen (ILPD), absolute improvements were small. The stability of learner weights and the negligible Oracle Gaps further suggest that the ensemble’s ability to approximate the best constituent learner is not materially altered by preprocessing in these settings.
From a practical perspective, the authors recommend that decisions on data preprocessing should be informed by dataset-specific characteristics rather than applied universally. For ensembles of tree-based, preprocessing-invariant learners, time and resources allocated to aggressive preprocessing may yield minimal return, whereas datasets with particular issues or when using preprocessing-sensitive learners may still benefit from targeted preprocessing.
The source document reports that only three benchmark datasets were used; this limits generalizability to other clinical tasks or data regimes. The manuscript does not provide detailed descriptions of the exact preprocessing steps in this summary, so readers requiring replication should consult the full preprint or accompanying materials for procedural specifics. All datasets used are publicly available (Kaggle and UCI links cited in the source), and the authors declared no competing interests. Ethical approvals and reporting guidelines were addressed per the authors’ statements.
Preprocessing had limited impact on predictive performance and did not materially change oracle behavior for Super Learner ensembles composed of preprocessing-invariant tree-based learners across three clinical datasets. Small, statistically significant improvements were observed for ILPD but with modest absolute effect sizes. The study supports guiding preprocessing decisions by dataset characteristics rather than adopting preprocessing as a default step for tree-based ensemble pipelines.