---
title: "Balanced Risk Integrity Index for Clinical Prediction Alerts under Competing Risks"
id: "medrxiv-17-balanced-risk-integrity-index-a-stratum-level-metric-for-evaluating-clinical"
canonical_url: "https://medichelpline.com/clinical-feed/medrxiv-17-balanced-risk-integrity-index-a-stratum-level-metric-for-evaluating-clinical"
content_type: "clinical_feed_article"
specialty: "Nephrology"
source_name: "medRxiv (Clinical Preprints)"
source_url: "https://www.medrxiv.org/content/10.64898/2026.10.14.26357330v1?rss=1"
published_at: "2026-10-16T12:00:00.000Z"
evidence_level: "Verified Feed"
license: "CC-BY-NC-4.0 / Informational Use"
---
# Balanced Risk Integrity Index for Clinical Prediction Alerts under Competing Risks
## Provenance & Clinical Metadata
- **Canonical URL:** https://medichelpline.com/clinical-feed/medrxiv-17-balanced-risk-integrity-index-a-stratum-level-metric-for-evaluating-clinical
- **Specialty:** [Nephrology](https://medichelpline.com/clinical-feed/nephrology.md)
- **Primary Source:** medRxiv (Clinical Preprints)
- **Source URL:** [Original Journal Publication](https://www.medrxiv.org/content/10.64898/2026.10.14.26357330v1?rss=1)
- **Published At:** 2026-10-16T12:00:00.000Z
- **Evidence Rating:** Verified Feed
## Executive GIST (TL;DR)
- The authors developed the **Balanced Risk Integrity Index (BRII)** as a stratum-level metric defined as the proportion of target events among target events, competing deaths, and early-censored observations within a flagged high-risk stratum. - BRII is algebraically related to **PPV** and is intended to be reported alongside a component decomposition that separates target events, competing deaths, and early censoring in the flagged group. - Validation used seven acute kidney injury (**AKI**) prediction models trained in **MIMIC‑IV** and externally validated in **MIMIC‑III** and **eICU‑CRD**, totaling 116,010 patients across cohorts. - In 48-hour AKI prediction for the top 10% risk stratum, BRII ranged 0.90–0.96 in MIMIC‑III but was under 0.26 across all models in eICU‑CRD, where 61.5% of evaluated patients were censored before the prediction horizon. - Within the eICU‑CRD top-10% strata, 37.0%–50.2% of patients were early-censored, 12.2%–15.5% experienced AKI, and 3.4%–8.1% died before AKI; those component shares drove low BRII values. - BRII and PPV produced different model orderings: the two metrics reordered at least one model pair in 34 of 48 cohort-outcome-top-k comparisons, indicating they capture distinct information. - Simulation of random censoring for 48-hour AKI prediction showed BRII could fall by as much as 0.80 while binary-label AUROC shifted by less than 0.02, pointing to BRII’s sensitivity to censoring and competing events. - The authors make source data and code available; the datasets used are public via PhysioNet and the study states de-identified data use was exempt from IRB oversight.
## Clinical Analysis & Structured Key Points
Balanced Risk Integrity Index: a stratum-level metric for evaluating clinical prediction alerts under competing risks and censoring | medRxiv Skip to main content Balanced Risk Integrity Index: a stratum-level metric for evaluating clinical prediction alerts under competing risks and censoring Inyong Jeong , Taeyeong Lee , Jin-Hyun Park , Yeongmin Kim , Hwamin Lee doi: https://doi.org/10.64898/2026.10.14.26357330 Inyong Jeong Korea University College of Medicine Find this author on Google Scholar Find this author on PubMed Search for this author on this site Taeyeong Lee Korea University College of Medicine Find this author on Google Scholar Find this author on PubMed Search for this author on this site Jin-Hyun Park Korea University College of Medicine Find this author on Google Scholar Find this author on PubMed Search for this author on this site Yeongmin Kim Korea University College of Medicine Find this author on Google Scholar Find this author on PubMed Search for this author on this site Hwamin Lee Korea University College of Medicine Find this author on Google Scholar Find this author on PubMed Search for this author on this site For correspondence: hwamin{at}korea.ac.kr Abstract Info/History Metrics Data/Code Preview PDF Abstract Background: Conventional discrimination metrics, such as the area under the receiver operating characteristic curve (AUROC), do not characterize the composition of outcomes among patients flagged as high risk by clinical prediction models. This limitation is particularly relevant in critical care, where competing deaths and incomplete follow-up can complicate the interpretation of prediction alerts. We developed the Balanced Risk Integrity Index (BRII), a stratum-level metric defined as the proportion of target events among target events, competing deaths, and early-censored observations in a flagged high-risk stratum. BRII is algebraically related to positive predictive value (PPV) and is reported alongside its component decomposition to characterize the outcome composition of flagged patients. Methods: We evaluated BRII using seven acute kidney injury (AKI) prediction models developed in MIMIC-IV and externally validated in MIMIC-III and eICU-CRD (116,010 patients in total). Additional simulations examined the effects of competing deaths and early censoring on BRII and conventional model performance metrics. Results: For 48-hour AKI prediction in the top 10% risk stratum, BRII ranged from 0.90 to 0.96 in MIMIC-III, compared with less than 0.26 across all models in eICU-CRD, where 61.5% of evaluated patients were censored before the prediction horizon. In the eICU-CRD top 10% strata for the same target, 37.0% to 50.2% of patients were censored early, 12.2% to 15.5% had AKI, and 3.4% to 8.1% died before AKI. BRII and PPV ordered at least one model pair differently in 34 of 48 cohort-outcome-top-k groups. Under simulated random censoring for 48-hour AKI prediction, BRII declined by up to 0.80 while binary-label AUROC changed by less than 0.02. Conclusions: BRII provided complementary information on high-risk stratum composition, yielding different model rankings from PPV and revealing substantial differences across external validation cohorts. Interpreted alongside PPV and its component decomposition, BRII offers a standardized approach to evaluating clinical prediction alerts across models and observation environments. Competing Interest Statement The authors have declared no competing interest. Author Declarations I confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained. Yes The details of the IRB/oversight body that provided approval or exemption for the research described are given below: All databases contain de-identified data. Use of these data is exempt from institutional review board approval under 45 CFR 46.101(b)(4). Access was obtained through PhysioNet Credentialed Health Data Use Agreements. I confirm that all necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived, and that any patient/participant/sample identifiers included were not known to anyone (e.g., hospital staff, patients or participants themselves) outside the research group so cannot be used to identify individuals. Yes I understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance). Yes I have followed all appropriate research reporting guidelines, such as any relevant EQUATOR Network research reporting checklist(s) and other pertinent material, if applicable. Yes Data Availability MIMIC-IV, MIMIC-III, and eICU-CRD are publicly available through PhysioNet (https://physionet.org). Source data for all figures and tables are provided with this paper. Funder Information Declared Institute of Information & Communications Technology Planning & Evaluation , IITP-2026-RS-2022-00156439 National Research Foundation of Korea , RS-2026-25477844 Copyright The copyright holder for this preprint is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. It is made available under a CC-BY 4.0 International license . Back to top Previous Next Posted October 16, 2026. Download PDF Data/Code Email Thank you for your interest in spreading the word about medRxiv. NOTE: Your email address is requested solely to identify you as the sender of this article. Your Email * Your Name * Send To * Enter multiple addresses on separate lines or separate them with commas. You are going to email the following Balanced Risk Integrity Index: a stratum-level metric for evaluating clinical prediction alerts under competing risks and censoring Message Subject (Your Name) has forwarded a page to you from medRxiv Message Body (Your Name) thought you would like to see this page from the medRxiv website. Your Personal Message CAPTCHA This question is for testing whether or not you are a human visitor and to prevent automated spam submissions. Share Balanced Risk Integrity Index: a stratum-level metric for evaluating clinical prediction alerts under competing risks and censoring Inyong Jeong , Taeyeong Lee , Jin-Hyun Park , Yeongmin Kim , Hwamin Lee medRxiv 2026.10.14.26357330; doi: https://doi.org/10.64898/2026.10.14.26357330 Share This Article: Copy Citation Tools Balanced Risk Integrity Index: a stratum-level metric for evaluating clinical prediction alerts under competing risks and censoring Inyong Jeong , Taeyeong Lee , Jin-Hyun Park , Yeongmin Kim , Hwamin Lee medRxiv 2026.10.14.26357330; doi: https://doi.org/10.64898/2026.10.14.26357330 Citation Manager Formats BibTeX Bookends EasyBib EndNote (tagged) EndNote 8 (xml) Medlars Mendeley Papers RefWorks Tagged Ref Manager RIS Zotero Tweet Widget Facebook Like Google Plus One Subject Areas All Articles Addiction Medicine (629) Allergy and Immunology (914) Anesthesia (343) Cardiovascular Medicine (4925) Dentistry and Oral Medicine (488) Dermatology (422) Emergency Medicine (667) Endocrinology (including Diabetes Mellitus and Metabolic Disease) (1658) Epidemiology (16128) Forensic Medicine (35) Gastroenterology (1228) Genetic and Genomic Medicine (7175) Geriatric Medicine (740) Health Economics (1081) Health Informatics (5190) Health Policy (1453) Health Systems and Quality Improvement (1810) Hematology (596) HIV/AIDS (1366) Infectious Diseases (except HIV/AIDS) (16403) Intensive Care and Critical Care Medicine (1189) Medical Education (687) Medical Ethics (156) Nephrology (734) Neurology (7449) Nursing (373) Nutrition (1111) Obstetrics and Gynecology (1274) Occupational and Environmental Health (1024) Oncology (3693) Ophthalmology (1077) Orthopedics (400) Otolaryngology (461) Pain Medicine (488) Palliative Medicine (142) Pathology (715) Pediatrics (1838) Pharmacology and Therapeutics (745) Primary Care Research (780) Psychiatry and Clinical Psychology (6042) Public and Global Health (9890) Radiology and Imaging (2482) Rehabilitation Medicine and Physical Therapy (1495) Respiratory Medicine (1260) Rheumatology (655) Sexual and Reproductive Health (792) Sports Medicine (591) Surgery (794) Toxicology (109) Transplantation (314) Urology (300)
## Related Clinical Research

- [3m-SMEF Protects Against Ischemia-Reperfusion Acute Kidney Injury by Preserving Na⁺/K⁺-ATPase](https://medichelpline.com/clinical-feed/biorxiv-8-modified-3rd-generation-synchronization-modulation-electric-field-3m-smef.md)
- [Five-Year Outcomes of Kidney Transplants From Deceased Donors With Diabetes: Function and Pathology](https://medichelpline.com/clinical-feed/pubmed-42804549.md) (DOI: 10.1111/ctr.70698)
- [Risk factors for 90-day RRT failure after cardiac surgery AKI treated with CRRT](https://medichelpline.com/clinical-feed/pubmed-42736125.md) (DOI: 10.3760/cma.j.cn112137-20260204-00393)
- [Transportable AKI Prediction with an Explainable XGBoost Model Using MIMIC‑IV](https://medichelpline.com/clinical-feed/medrxiv-2-toward-transportable-acute-kidney-injury-prediction-an-explainable-xgboost.md)
- [Cross-System ML Meta-Analysis Identifies Value-Specific Risk Drivers for Acute Kidney Injury](https://medichelpline.com/clinical-feed/medrxiv-7-cross-system-meta-analysis-of-machine-learning-predictors-identifies-value.md)

## Navigation
- [← Back to Nephrology Feed](https://medichelpline.com/clinical-feed/nephrology.md)
- [← All Clinical Specialties](https://medichelpline.com/clinical-feed.md)
## Medical & Regulatory Disclaimer

> [!CAUTION]
> MedicHelpline content is structured for research, educational, and professional discovery purposes. It does not constitute individual medical advice, clinical diagnosis, or treatment recommendations.
> Always verify dosing, contraindications, and regulatory alerts against official product labeling and primary regulatory sources before clinical decision-making.