The authors simulated a smart contract that required peer hospitals to validate locally trained models before a model could enter a shared ensemble. Hospitals committed SHA-256 digests of locally trained XGBoost and random-forest models to a Solidity contract, and peers posted digest-bound validation AUROCs. The contract admitted a model when the median peer AUROC reached at least 0.70, creating an auditable ledger of which models had been verified by peers. The study team reported that this attestation mechanism excluded grossly poisoned or substituted models in every random seed under the tested attacks, providing a verifiable record of model provenance for consortium members.
Two primary aggregation methods were evaluated. BFE-PW pooled admitted models by weighted logit averaging. BFE-Stack used stacking with federated recalibration. The authors also experimented with recalibration schemes, including a median-of-sites recalibration intended to resist poisoned recalibration attempts. The source material notes that federated recalibration choices materially affected outcomes: a poisoned recalibration could invert performance for BFE-PW unless the median-of-sites approach was used.
The simulation exercised seven attacks directed at training, attestation, recalibration and model delivery. Under gross label flipping, the contract’s gate excluded poisoned models every time; FedAvg, however, suffered—losing 29% of its AUPRC under the same attack. Multi-Krum FedAvg offered similar protection to the contract gate for gross substitutions. The authors observed a failure mode: a targeted flip of female deaths passed the attestation threshold and lowered sensitivity for deaths among women from 32.8% to 27.5%. This demonstrates the contract could not detect attacks that preserved validation discrimination across peers. Poisoned recalibration produced extreme failures for BFE-PW (reported AUROC 0.098) unless a median-of-sites recalibration was implemented (reported AUROC 0.902).
Performance comparisons used MIMIC-IV v3.1 data: 425,215 admissions and 2.35% in-hospital mortality with predictors taken from the first 24 hours. With large hospitals included, BFE-PW matched FedAvg in AUROC (0.902). BFE-Stack matched FedProx (0.907 and 0.906 reported), while local-only XGBoost reached 0.910 and centralised XGBoost 0.915—both higher than BFE variants. AUPRC was lower for the federated ensembles compared with centralised training. In a data-scarce regime retaining 5% of each hospital’s patients, BFE-PW exceeded local-only models (AUROC 0.866 vs 0.844), indicating a potential advantage for small, data-limited sites.
Pooled calibration metrics masked site-level miscalibration. The authors reported one hospital with two-fold under-prediction (observed-to-expected ratio 2.13) in the pooled ensemble, a clinically meaningful miscalibration. Applying a local intercept correction at that hospital adjusted the observed-to-expected ratio to 0.93, restoring closer local calibration. The source emphasizes that pooling can conceal site-specific risk shifts and that local recalibration remains necessary to correct such distortions.
The manuscript quantified blockchain resource use. One aggregation run used 37 transactions and approximately 3.3 million gas. The authors reported that gas consumption rose roughly quadratically with consortium size, signaling nontrivial on-chain costs as the number of participating sites increased. These metrics indicate a trade-off: auditable attestation and forensic traceability versus growing transaction complexity and cost as a network expands.
The authors conclude that contract-enforced peer attestation provides an auditable, automatic exclusion mechanism for grossly poisoned or substituted models at a modest accuracy cost, and that the approach is especially suited to consortia of smaller hospitals that require verifiable records of model admission. However, the study team observed clear limitations: the contract did not detect adversarial manipulations that preserve validation discrimination across peers, and poisoned recalibration remained a critical vulnerability unless robust median-based recalibration was applied. The simulation also revealed pooled calibration can hide important per-site errors, and that blockchain transaction costs scale substantially with consortium size. The source did not report prospective deployment details, regulatory pathway milestones, or real-world clinical implementation outcomes. Remaining open questions documented by the authors include how to detect attacks that preserve validation discrimination in a federated attestation system, how to minimize on-chain costs as consortia grow, and how best to integrate mandatory local recalibration protocols into operational workflows.