Electronic health records (EHRs) offer extensive real-world data for disease risk prediction, but many machine learning models in this space produce associations that are difficult to inspect or to use in clinical reasoning. The study introduces a scalable approach to causal-interpretable machine learning for cancer prescreening that leverages Causal Bayesian networks (CBNs). CBNs encode conditional dependencies, putative directional relations, and probabilistic evidence propagation in a directed acyclic graph (DAG), enabling interpretable evidence paths rather than opaque correlations.
Conventional CBN structure learning methods become unstable and computationally expensive when applied to large-scale, high-dimensional EHR data. Instability refers to inconsistent recovered structures across different runs or data partitions, while computational expense limits applicability to multi-million-sample cohorts. These limitations constrain the use of fully causal-interpretable models in real-world prescreening tasks derived from EHR repositories.
To address scalability and stability challenges, the authors propose UPEBNL, a framework for parallel CBN learning tailored to prescreening from large observational data. UPEBNL integrates three core components:
These components are designed to yield more stable and interpretable dependency structures while markedly reducing computation time compared to conventional single-shot CBN learning on the entire dataset.
UPEBNL was evaluated in high-dimensional and multi-million-sample simulations to assess both structural recovery accuracy and computational efficiency. In these simulations, UPEBNL improved structural recovery accuracy by nearly 40% relative to conventional CBN learning strategies. Computationally, the framework achieved up to a 221.28-fold speedup, demonstrating substantial gains in feasibility for large-scale applications. The simulation datasets were generated according to procedures described in the manuscript; specifics of those procedures were reported in the source.
The authors applied UPEBNL to real-world EHR data to develop a prescreening model for esophageal cancer. The learned CBN provided interpretable evidence paths linking features to predicted risk. On validation, the esophageal cancer prescreening model achieved an AUC of 0.8171, indicating good discrimination in the validation set. Calibration analyses and decision curve analysis were conducted and reported to support model reliability and potential clinical benefit.
UPEBNL was also applied to an EHR-based colorectal cancer prescreening task. The resultant CBN again yielded interpretable dependency structures and evidence propagation paths. Validation performance for colorectal cancer prescreening produced an AUC of 0.784. As with the esophageal model, calibration and decision curve analyses were reported to further assess reliability and clinical utility.
Beyond discrimination (AUC), the authors report calibration analyses and decision curve analyses for the learned CBN models. These evaluations were used to assess whether predicted probabilities matched observed outcomes and to estimate potential net benefit across decision thresholds, thereby informing clinical utility for prescreening. The source states that these analyses supported the reliability and clinical usefulness of the models, though detailed numeric results from the calibration and decision curve analyses beyond the AUCs were not reported in the source summary.
The simulation datasets were generated by the authors as described in the manuscript. The real-world EHR data used in the prescreening analyses are not publicly available because they contain sensitive health information and are governed by institutional data-use restrictions. Access to these data may be granted on reasonable request to the corresponding author, subject to approval by the relevant data custodian and completion of applicable data-use and data-security agreements.
The research was approved by the Institutional Review Board of the School of Public Health, Shandong University (approval number LL20240308). The authors declared no competing interests. Funding sources named in the source include the National Natural Science Foundation of China, China Postdoctoral Science Foundation, and the National Key Research and Development Program of China.
The study demonstrates that scalable CBN learning via the UPEBNL framework can recover more accurate and stable dependency structures from large-scale EHR data while greatly reducing computation time. When applied to prescreening for esophageal and colorectal cancer, the approach yielded interpretable CBNs with validation AUCs of 0.8171 and 0.784, respectively, and analyses reported to support calibration and clinical utility. These findings suggest that parallel, quality-aware aggregation strategies can make causal-interpretable models feasible for population-scale EHR prescreening.
Note: The source reports the main performance metrics and methodological components summarized here. Additional methodological details, full numerical results from calibration and decision curve analyses, and implementation code were referenced in the manuscript; the real-world EHR data themselves are not publicly available per the source.