---
title: "Multimodal AI Detects In-Hospital Lung Cancer and Heart Failure from Routine Data"
id: "medrxiv-11-explainable-multimodal-ai-for-in-hospital-detection-of-lung-cancer-and-heart"
canonical_url: "https://medichelpline.com/clinical-feed/medrxiv-11-explainable-multimodal-ai-for-in-hospital-detection-of-lung-cancer-and-heart"
content_type: "clinical_feed_article"
specialty: "Radiology"
source_name: "medRxiv (Clinical Preprints)"
source_url: "https://www.medrxiv.org/content/10.64898/2026.10.22.26366034v1?rss=1"
published_at: "2026-10-23T12:00:00.000Z"
evidence_level: "Verified Feed"
license: "CC-BY-NC-4.0 / Informational Use"
---
# Multimodal AI Detects In-Hospital Lung Cancer and Heart Failure from Routine Data
## Provenance & Clinical Metadata
- **Canonical URL:** https://medichelpline.com/clinical-feed/medrxiv-11-explainable-multimodal-ai-for-in-hospital-detection-of-lung-cancer-and-heart
- **Specialty:** [Radiology](https://medichelpline.com/clinical-feed/radiology.md)
- **Primary Source:** medRxiv (Clinical Preprints)
- **Source URL:** [Original Journal Publication](https://www.medrxiv.org/content/10.64898/2026.10.22.26366034v1?rss=1)
- **Published At:** 2026-10-23T12:00:00.000Z
- **Evidence Rating:** Verified Feed
## Executive GIST (TL;DR)
- The study linked **MIMIC-IV** admissions (73,637 patients) to chest radiographs, radiology reports, 12-lead **ECG** recordings and laboratory tests obtained within the first 48 hours of admission. - Investigators excluded prior cases for each target and developed single-source models plus gradient boosting and three fusion strategies: early, late and attention-based fusion on patient-level splits. - Disease prevalence in the cohort was reported as 1.7% for **lung cancer** and 15.6% for **heart failure**; models were compared using AUROC and other discrimination measures. - For **lung cancer**, attention-based fusion achieved AUROC 0.833 (95% CI 0.809–0.859), versus 0.753 for gradient boosting on laboratory data. - For **heart failure**, attention fusion reached AUROC 0.885 (95% CI 0.878–0.892), versus 0.794 for laboratory gradient boosting; early and late fusion performed similarly to attention fusion. - The study team observed that laboratory data and radiology reports drove most of the contribution to **lung cancer** predictions, while the **ECG** contributed most for **heart failure** predictions. - Explainability checks included a deletion test (passed) and a weight-randomisation check; attributions for **ECG** passed the latter but laboratory attributions did not. - The authors audited fairness across sex, age, race and ethnicity, and insurance; they reported discrimination decreased with age for **heart failure**. - A simulated federated evaluation compared centralised, federated and local training across five unequal hospital splits: federated training recovered 95% of the pooled centralised gain for **heart failure**; for **lung cancer**, FedAvg recovered 51% and FedProx recovered 82% of the pooled benefit. - The authors archived the analysis plan and code and stated that external validation is needed; they noted limitations including single-centre retrospective design and rarity of lung cancer cases affecting federated recovery.
## Clinical Analysis & Structured Key Points
Explainable Multimodal AI for In-Hospital Detection of Lung Cancer and Heart Failure Using Routine Data: Development, Internal Validation, and Simulated Federated Evaluation | medRxiv Skip to main content Explainable Multimodal AI for In-Hospital Detection of Lung Cancer and Heart Failure Using Routine Data: Development, Internal Validation, and Simulated Federated Evaluation View ORCID Profile Mostak Ahmed , View ORCID Profile Md Mostafizur Rahman , View ORCID Profile Sabera Tabassum Wahid , View ORCID Profile Golam Rabbi , View ORCID Profile Al Rafy , View ORCID Profile Golam Sarwar Khondoker , View ORCID Profile Shovit Dutta , View ORCID Profile Mohammad Amir Saadat , View ORCID Profile Md. Masuqul Haque doi: https://doi.org/10.64898/2026.10.22.26366034 Mostak Ahmed 1 University of Dhaka; Find this author on Google Scholar Find this author on PubMed Search for this author on this site ORCID record for Mostak Ahmed For correspondence: mostak{at}du.ac.bd Md Mostafizur Rahman 2 San Francisco Bay University; Find this author on Google Scholar Find this author on PubMed Search for this author on this site ORCID record for Md Mostafizur Rahman Sabera Tabassum Wahid 3 The University of Queensland; Find this author on Google Scholar Find this author on PubMed Search for this author on this site ORCID record for Sabera Tabassum Wahid Golam Rabbi 4 Zhengzhou University; Find this author on Google Scholar Find this author on PubMed Search for this author on this site ORCID record for Golam Rabbi Al Rafy 5 Westcliff University; Find this author on Google Scholar Find this author on PubMed Search for this author on this site ORCID record for Al Rafy Golam Sarwar Khondoker 6 State University of Bangladesh; Find this author on Google Scholar Find this author on PubMed Search for this author on this site ORCID record for Golam Sarwar Khondoker Shovit Dutta 7 Chattogram City Corporation Memon Maternity Hospital; Find this author on Google Scholar Find this author on PubMed Search for this author on this site ORCID record for Shovit Dutta Mohammad Amir Saadat 8 Bandarban University; Find this author on Google Scholar Find this author on PubMed Search for this author on this site ORCID record for Mohammad Amir Saadat Md. Masuqul Haque 9 University of Rajshahi Find this author on Google Scholar Find this author on PubMed Search for this author on this site ORCID record for Md. Masuqul Haque Abstract Info/History Metrics Supplementary material Data/Code Preview PDF Abstract Objective: To determine whether combining four routine data sources improves in-hospital detection of lung cancer and heart failure, which sources drive each prediction, whether explanations are faithful, whether models are fair, and how much benefit federated training retains. Methods: In this retrospective single-centre study, we linked MIMIC-IV admissions (73,637 patients) to chest radiographs, radiology reports, 12-lead electrocardiograms (ECGs) and laboratory tests from the first 48 hours. For each disease, excluding prior cases, we compared single-source models, gradient boosting and early, late and attention-based fusion on patient-level splits. We tested explanations for faithfulness and weight dependence, audited performance by sex, age, race and ethnicity, and insurance, and simulated five unequal hospitals to compare federated, centralised and local training. Results: Lung cancer was coded in 1.7% and heart failure in 15.6% of patients. For lung cancer, attention fusion reached an area under the ROC curve (AUROC) of 0.833 (95% CI 0.809-0.859) against 0.753 for gradient boosting on laboratory data; for heart failure, 0.885 (0.878-0.892) against 0.794 (both p < 0.001). Early and late fusion performed similarly. Laboratory data and radiology reports contributed most to lung cancer, and the ECG to heart failure. Explanations passed a deletion test; a weight-randomisation check on absolute attributions passed for ECG but not for laboratory explanations. For heart failure, discrimination fell with age. Federated training recovered 95% of the centralised gain over local training for heart failure; for lung cancer, federated averaging (FedAvg) recovered 51% and FedProx 82%. Conclusion: Fusing routine data improved in-hospital detection of both diseases over laboratory data alone, and which data matter depends on the disease. Explanation checks should be run per source and per similarity measure, and performance in older patients monitored. For the rare outcome, FedProx, which limits drift between sites, retained more of the pooled benefit than FedAvg. External validation is needed. Competing Interest Statement The authors have declared no competing interest. Clinical Protocols https://doi.org/10.5281/zenodo.23506613 Author Declarations I confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained. Yes I confirm that all necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived, and that any patient/participant/sample identifiers included were not known to anyone (e.g., hospital staff, patients or participants themselves) outside the research group so cannot be used to identify individuals. Yes I understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance). Yes I have followed all appropriate research reporting guidelines, such as any relevant EQUATOR Network research reporting checklist(s) and other pertinent material, if applicable. Yes Data Availability The data are available from PhysioNet to credentialed users who sign the respective data use agreements (MIMIC-IV, MIMIC-CXR, MIMIC-CXR-JPG and MIMIC-IV-ECG). Under these agreements the authors cannot share patient-level data. Aggregate results are included in the article and its Supplementary Material. The pre-specified analysis plan and code release v1.0-protocol are archived at https://doi.org/10.5281/zenodo.23506613. https://doi.org/10.5281/zenodo.23506613 https://physionet.org/content/mimiciv/3.1/ https://physionet.org/content/mimic-cxr/2.1.0/ https://physionet.org/content/mimic-cxr-jpg/2.1.0/ https://physionet.org/content/mimic-iv-ecg/1.0/ Copyright The copyright holder for this preprint is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. It is made available under a CC-BY-NC-ND 4.0 International license . Back to top Previous Next Posted October 23, 2026. Download PDF Supplementary Material Data/Code Email Thank you for your interest in spreading the word about medRxiv. NOTE: Your email address is requested solely to identify you as the sender of this article. Your Email * Your Name * Send To * Enter multiple addresses on separate lines or separate them with commas. You are going to email the following Explainable Multimodal AI for In-Hospital Detection of Lung Cancer and Heart Failure Using Routine Data: Development, Internal Validation, and Simulated Federated Evaluation Message Subject (Your Name) has forwarded a page to you from medRxiv Message Body (Your Name) thought you would like to see this page from the medRxiv website. Your Personal Message CAPTCHA This question is for testing whether or not you are a human visitor and to prevent automated spam submissions. Share Explainable Multimodal AI for In-Hospital Detection of Lung Cancer and Heart Failure Using Routine Data: Development, Internal Validation, and Simulated Federated Evaluation Mostak Ahmed , Md Mostafizur Rahman , Sabera Tabassum Wahid , Golam Rabbi , Al Rafy , Golam Sarwar Khondoker , Shovit Dutta , Mohammad Amir Saadat , Md. Masuqul Haque medRxiv 2026.10.22.26366034; doi: https://doi.org/10.64898/2026.10.22.26366034 Share This Article: Copy Citation Tools Explainable Multimodal AI for In-Hospital Detection of Lung Cancer and Heart Failure Using Routine Data: Development, Internal Validation, and Simulated Federated Evaluation Mostak Ahmed , Md Mostafizur Rahman , Sabera Tabassum Wahid , Golam Rabbi , Al Rafy , Golam Sarwar Khondoker , Shovit Dutta , Mohammad Amir Saadat , Md. Masuqul Haque medRxiv 2026.10.22.26366034; doi: https://doi.org/10.64898/2026.10.22.26366034 Citation Manager Formats BibTeX Bookends EasyBib EndNote (tagged) EndNote 8 (xml) Medlars Mendeley Papers RefWorks Tagged Ref Manager RIS Zotero Tweet Widget Facebook Like Google Plus One Subject Areas All Articles Addiction Medicine (634) Allergy and Immunology (914) Anesthesia (346) Cardiovascular Medicine (4943) Dentistry and Oral Medicine (490) Dermatology (425) Emergency Medicine (672) Endocrinology (including Diabetes Mellitus and Metabolic Disease) (1667) Epidemiology (16164) Forensic Medicine (35) Gastroenterology (1236) Genetic and Genomic Medicine (7213) Geriatric Medicine (747) Health Economics (1091) Health Informatics (5222) Health Policy (1456) Health Systems and Quality Improvement (1812) Hematology (597) HIV/AIDS (1370) Infectious Diseases (except HIV/AIDS) (16427) Intensive Care and Critical Care Medicine (1192) Medical Education (690) Medical Ethics (156) Nephrology (739) Neurology (7499) Nursing (375) Nutrition (1114) Obstetrics and Gynecology (1281) Occupational and Environmental Health (1031) Oncology (3708) Ophthalmology (1079) Orthopedics (401) Otolaryngology (462) Pain Medicine (493) Palliative Medicine (142) Pathology (717) Pediatrics (1844) Pharmacology and Therapeutics (749) Primary Care Research (781) Psychiatry and Clinical Psychology (6065) Public and Global Health (9915) Radiology and Imaging (2499) Rehabilitation Medicine and Physical Therapy (1500) Respiratory Medicine (1263) Rheumatology (655) Sexual and Reproductive Health (794) Sports Medicine (594) Surgery (795) Toxicology (109) Transplantation (315) Urology (303)
## Related Clinical Research

- [Dietary PUFA Intake, Sleep Patterns, and Lung Cancer Risk: Case-Control Findings from Southwest Ch](https://medichelpline.com/clinical-feed/plos-one-23-associations-of-dietary-polyunsaturated-fatty-acids-and-sleep-patterns-with.md)
- [Psychosocial profile in adults with congenital heart disease by documented anxiety disorder history](https://medichelpline.com/clinical-feed/plos-one-21-psychosocial-profile-of-adults-with-congenital-heart-disease-according-to.md)
- [CKM Burden Predicts Echocardiographic Recovery and Cardiovascular Events in Hypertension](https://medichelpline.com/clinical-feed/medrxiv-6-impact-of-cardiovascular-kidney-metabolic-burden-on-echocardiographic.md)
- [Targeted Crizotinib Therapy Extends Survival in ROS1 Lung Cancer Patient](https://medichelpline.com/clinical-feed/stat-news-4-how-a-targeted-drug-kept-one-patient-alive-15-years-but-failed-to-save-her.md)
- [Phenome-Wide Clinical Atlas Linking Obstructive Sleep Apnea to Multidomain EHR Signals](https://medichelpline.com/clinical-feed/medrxiv-18-a-clinical-atlas-for-phenome-wide-association-study-of-obstructive-sleep-apnea.md)

## Navigation
- [← Back to Radiology Feed](https://medichelpline.com/clinical-feed/radiology.md)
- [← All Clinical Specialties](https://medichelpline.com/clinical-feed.md)
## Medical & Regulatory Disclaimer

> [!CAUTION]
> MedicHelpline content is structured for research, educational, and professional discovery purposes. It does not constitute individual medical advice, clinical diagnosis, or treatment recommendations.
> Always verify dosing, contraindications, and regulatory alerts against official product labeling and primary regulatory sources before clinical decision-making.