Early, reliable disease prediction from structured clinical data remains difficult when datasets are small, highly imbalanced, and contain few positive cases. The authors note that conventional machine learning (ML) and deep learning models can fail to capture clinically meaningful relationships under such low-data representation conditions because statistical associations between features and targets may be weak. To address this, the study proposes a clinically grounded GPT2-based table-to-text framework that leverages the contextual reasoning capacity of GPT models to capture relationships that statistical learning alone may miss in low-volume clinical datasets.
Structured patient records from four public healthcare datasets were used: heart disease, heart failure, chronic kidney disease, and thyroid cancer recurrence. The authors report using records available from the UC Irvine Machine Learning Repository. Each structured record was transformed into a physician-style textual description to provide a natural-language representation of the tabular data.
To increase minority-class representation while retaining clinical meaning, the authors applied GPT4 to generate medical paraphrases of the physician-style texts. Both the original physician-style texts and the GPT4-generated paraphrases were combined and used to fine-tune a GPT2 model for prediction tasks.
The manuscript also describes inclusion of gradient-based explainable AI analysis to identify which input features most influenced model predictions. This explainability component was intended to evaluate whether the GPT2-based framework emphasized clinically meaningful variables, particularly under scenarios of severe class imbalance where conventional models may underperform.
A gradient-based explainability method was incorporated to determine feature influence on GPT2 model outputs. The authors emphasize that explainable prediction mechanisms were part of the framework so clinicians and model developers can inspect which variables drive risk estimates. According to the source, this approach helped demonstrate that the model consistently prioritized clinically relevant predictors even when positive cases were rare.
The proposed GPT2-based table-to-text framework reportedly achieved consistently strong predictive performance across the evaluated datasets. The performance metrics reported in the preprint are: average precision 0.96, specificity 0.97, sensitivity 0.96, and F1-score 0.96.
Compared with traditional ML, deep learning, transformer-based, and GAN-augmented approaches, the framework is reported to have achieved improved sensitivity, stronger generalization, and more stable predictive behavior in low-data and high-class-imbalance settings. The authors highlight that the framework consistently emphasized clinically meaningful variables under severe class imbalance — a scenario where conventional ML and neural-network models often struggle to preserve clinically interpretable feature importance.
The source frames these results as evidence that integrating contextual clinical reasoning via a language-model approach can be advantageous when sample sizes are limited and statistical signals are weak.
The authors conclude that a GPT2-based table-to-text framework offers a practical and clinically interpretable method for disease prediction using limited structured healthcare data. By combining physician-style text representations, GPT4-based paraphrase augmentation for minority-class enrichment, and gradient-based explainability, the framework is presented as supporting early risk detection and transparent clinical decision support in low-resource environments.
The preprint suggests potential for reliable deployment in real-world low-volume clinical datasets, where traditional statistical approaches may underperform. It is important to note, as the authors do, that the work is a preprint and has not yet been peer reviewed; therefore, findings should not be used to guide clinical practice without further validation.
The authors report that datasets were sourced from the UC Irvine Machine Learning Repository. They declare no competing interests. The manuscript states that relevant ethical guidelines were followed and that informed consent and appropriate approvals or exemptions were obtained as described; specific IRB or oversight details were referenced in the author declarations section of the source. The work is released under a CC-BY-NC-ND 4.0 International license on medRxiv as a preprint.
Notes and limitations from the source