Multianalyte external quality assessment (EQA) panels are commonly interpreted one analyte at a time. Many panels, however, include features that have known relations — for example biochemical pathways, molecular interactions, or shared measurement processes — and these relations can produce joint patterns that may inform overall assay quality. The authors propose PathEQA, a machine-learning framework that leverages a user-supplied feature graph to guide random forest models so that these inter-feature relations can influence prediction of multianalyte outcomes.
PathEQA is a random forest–based framework in which a feature graph provided by the user encodes domain relations among measured features. The supplied graph may represent biochemical pathways, molecular interactions, shared measurement processes, or other relevant relations. The framework allows the same graph to influence multiple components of the model: feature representation, node-level candidate generation for tree splits, and selection of splits during tree construction. An optional local grouped decision mechanism is also available to allow grouped handling of features that are connected in the graph.
The framework permits the feature graph to act at three levels:
An optional grouped decision variant was implemented to allow the model to make local grouped decisions that explicitly treat connected features together. The precise algorithmic implementation details, hyperparameters, and code-level specifics were reported as part of the full paper; data and code are available from the authors upon reasonable request as stated in the source.
The authors evaluated PathEQA in two simulation paradigms. In graph-aligned simulations, the supplied graph reflected the true outcome-relevant relations among features. In graph-misspecified simulations, the supplied graph did not match the true relations and thus represented incorrect structural guidance. Performance was compared with ordinary random forest and with a simpler static network-sampling baseline in some experiments. Simulation results were reported across varying training sample sizes (for example, training sizes of 60–240 were specifically noted).
To illustrate the framework on real-world quality assessment data, the authors used a six-analyte catecholamine-related liquid chromatography–tandem mass spectrometry (LC-MS/MS) EQA data set. The data set comprised 929 records from 58 laboratories and 117 complete multianalyte panels. The catecholamine example was presented as a worked example of PathEQA rather than as a limitation of the method to this analyte class.
In graph-aligned simulations, the grouped variant of PathEQA produced a measurable reduction in test root mean squared error (RMSE) relative to ordinary random forest. Specifically, the grouped variant reduced RMSE by 7.4–9.4% across training sizes of 60–240. This indicates that when the supplied graph aligns with outcome-relevant structure, the feature-graph guidance can improve predictive accuracy in small-sample multivariate settings.
However, in graph-misspecified simulations the use of an incorrect graph could worsen prediction performance. This demonstrates the potential downside of applying graph guidance without verifying its relevance to the outcome.
In the catecholamine case study, full PathEQA performed similarly to ordinary random forest under laboratory-grouped cross-validation (RMSE 0.570 for PathEQA versus 0.569 for ordinary random forest). In the final-round temporal holdout, PathEQA showed a modest improvement (RMSE 0.307) compared with ordinary random forest (RMSE 0.318). Despite these improvements, a simpler static network-sampling baseline performed best in the case study, indicating that more elaborate graph-guided machinery is not guaranteed to outperform simpler approaches on every data set.
The analysis of feature relations in the catecholamine data highlighted that the dopamine–norepinephrine pair was the strongest two-feature pair for estimation, whereas the dopamine–norepinephrine–epinephrine triple best estimated multianalyte failure burden in this data set.
The collective results support a general conclusion: feature-graph guidance can improve small-sample multivariate quality assessment when the supplied structure is outcome-relevant. The observed gains in graph-aligned simulations and the modest real-data improvements in a temporal holdout illustrate potential benefits. Crucially, graph relevance must be tested rather than assumed because graph misspecification can degrade predictive performance. The fact that a simpler baseline outperformed full PathEQA in the catecholamine example underscores that model complexity should be justified by demonstrated gains on the specific data and validation scheme being used.
For practitioners conducting multianalyte EQA, PathEQA offers a structured way to incorporate domain knowledge about feature relations into a familiar tree-based ensemble approach. Recommended practical steps based on the paper’s findings include:
The authors note that all data produced in the study are available upon reasonable request. The data used for the catecholamine example were quality control data prepared by adding analytes into a bovine serum matrix and are not patient-derived. The authors declared no competing interests and confirmed that relevant ethical guidelines and approvals were followed.
PathEQA demonstrates a general approach for integrating user-supplied feature graphs with random forest models to support multianalyte EQA. The framework can reduce prediction error when the supplied graph encodes outcome-relevant structure, but it can also harm performance when the graph is misspecified. The catecholamine LC-MS/MS example illustrates both the promise and the limitations of graph-guided modeling in real EQA data.