Transformer-based models applied to longitudinal electronic health record (EHR) data typically use high-dimensional feature sets and long patient histories. This practice assumes that more input information improves predictive performance. However, increased feature dimensionality and longer sequence length raise computational costs and can limit scalability. The study evaluated how varying input complexity—both the number of features and the length of patient history sequences—affects model discrimination, calibration, risk stratification, and computational efficiency for a clinical prediction task.
The analysis used longitudinal EHR data from adults with mild asthma cared for within an integrated healthcare system. The supervised prediction target was acute asthma exacerbation. The study compared a reference transformer model using an 80-feature input representation with models that used reduced feature sets and shorter history sequences. Additional cohort details beyond this description were not reported in the source summary.
The authors evaluated three approaches to reduce input dimensionality:
These strategies produced reduced-dimensional feature sets that were compared to the 80-feature reference for predictive performance, calibration, and identification of high-risk patients.
Sequence length was varied by truncating patient histories using percentile-based cutoffs. The study examined the impact of moderate truncation of historical sequences on both predictive performance and computational cost. Specific percentile values used for truncation were not detailed in the abstract.
Model performance was assessed across multiple dimensions:
The summary reports comparative values for discrimination and training-time reductions; further metric specifics (e.g., confidence intervals, other discrimination metrics) were not provided in the abstract.
Models using fewer features achieved discrimination close to the 80-feature reference model. Reported AUROC values for reduced-dimensionality models ranged from 0.843 to 0.864 compared with 0.870 for the full model. This indicates a modest reduction in discrimination with substantially fewer inputs.
The authors observed attenuation of predicted risk at the upper tail in reduced-dimensionality models, indicating some loss of calibration among the highest predicted-risk patients. The abstract does not present calibration plots or quantitative calibration statistics.
Despite attenuation at the upper tail, reduced-dimensionality models identified similar high-risk populations and captured comparable proportions of asthma exacerbation events at clinically relevant thresholds. Thus, while extreme-risk calibration shifted modestly, operationally important stratification and threshold-based event capture remained similar to the full model according to the reported summary.
Moderate truncation of sequence length delivered substantial computational gains. Specifically, sequence-length reduction lowered training time by more than 70% while producing minimal loss in discrimination. This highlights a large efficiency benefit from reducing temporal input complexity.
The study was approved by the Kaiser Permanente Southern California IRB. Anonymized data supporting the study may be made available under conditions that include collaboration with the study team, funding to support collaboration, evidence of human-subject protections training, and execution of data-use agreements.
Funding declared included support from the National Heart, Lung, and Blood Institute (R01 HL 163049). Competing interests: one author reported consulting fees from AstraZeneca, grant support from Sanofi, and royalties from UpToDate; another author reported grant support from Sanofi and royalties from UpToDate. Remaining authors declared no relevant conflicts.
Within the scope of this analysis, transformer-based clinical prediction models maintained strong overall discrimination even when feature dimensionality was reduced. Reducing the number of features produced only modest declines in AUROC but introduced attenuation of predicted risk at the highest-risk levels, which may affect calibration-sensitive applications.
In contrast, moderate shortening of input sequence length produced very large computational savings (training-time reductions greater than 70%) with minimal changes in discrimination. These findings point to pragmatic trade-offs: aggressive dimensionality reduction can preserve operational risk-stratification while modest sequence truncation can substantially improve scalability and resource efficiency.
Model developers and health systems seeking to deploy transformer-based EHR predictors should therefore consider balancing feature selection and sequence-length design to optimize between predictive performance, calibration needs for high-risk patients, and computational constraints.
The source material provided an abstract and article metadata but did not include full methodological or numeric details in the summary. Specifics not reported in the abstract include exact cohort size and demographics, precise percentile cutoffs used for sequence truncation, the exact number of features retained in each reduced model, confidence intervals or statistical tests for AUROC differences, calibration statistics and plots, and architecture or hyperparameter details for the transformer models. Those details would need to be obtained from the full manuscript or accompanying data/code resources.