NASHmap: clinical utility of a machine learning model to identify patients at risk of NASH in real-world settings.

The NASHmap model is a non-invasive tool using 14 variables (features) collected in standard clinical practice to classify patients as probable nonalcoholic steatohepatitis (NASH) or non-NASH, and here we have explored its performance and prediction accuracy. The National Institute of Diabetes and Digestive Kidney Diseases (NIDDK) NAFLD Adult Database and the Optum Electronic Health Record (EHR) were used for patient data. Model performance metrics were calculated from correct and incorrect classifications for 281 NIDDK (biopsy-confirmed NASH and non-NASH, with and without stratification by type 2 diabetes status) and 1,016 Optum (biopsy-confirmed NASH) patients. NASHmap sensitivity in NIDDK is 81%, with a slightly higher sensitivity in T2DM patients (86%) than non-T2DM patients (77%). NIDDK patients misclassified by NASHmap had mean feature values distinct from correctly predicted patients, particularly for aspartate transaminase (AST; 75.88 U/L true positive vs 34.94 U/L false negative), and alanine transaminase (ALT; 104.09 U/L vs 47.99 U/L). Sensitivity was slightly lower in Optum at 72%. In an undiagnosed Optum cohort at risk for NASH (n = 2.9 M), NASHmap predicted 31% of patients as NASH. This predicted NASH group had AST and ALT mean levels above normal range of 0-35 U/L, and 87% had HbA1C levels > 5.7%. Overall, NASHmap demonstrates good sensitivity in predicting NASH status in both datasets, and NASH patients misclassified as non-NASH by NASHmap have clinical profiles closer to non-NASH patients.

Development of a novel machine learning model to predict presence of nonalcoholic steatohepatitis.

OBJECTIVE: To develop a computer model to predict patients with nonalcoholic steatohepatitis (NASH) using machine learning (ML). MATERIALS AND METHODS: This retrospective study utilized two databases: a) the National Institute of Diabetes and Digestive and Kidney Diseases (NIDDK) nonalcoholic fatty liver disease (NAFLD) adult database (2004-2009), and b) the Optum® de-identified Electronic Health Record dataset (2007-2018), a real-world dataset representative of common electronic health records in the United States. We developed an ML model to predict NASH, using confirmed NASH and non-NASH based on liver histology results in the NIDDK dataset to train the model. RESULTS: Models were trained and tested on NIDDK NAFLD data (704 patients) and the best-performing models evaluated on Optum data (~3,000,000 patients). An eXtreme Gradient Boosting model (XGBoost) consisting of 14 features exhibited high performance as measured by area under the curve (0.82), sensitivity (81%), and precision (81%) in predicting NASH. Slightly reduced performance was observed with an abbreviated feature set of 5 variables (0.79, 80%, 80%, respectively). The full model demonstrated good performance (AUC 0.76) to predict NASH in Optum data. DISCUSSION: The proposed model, named NASHmap, is the first ML model developed with confirmed NASH and non-NASH cases as determined through liver biopsy and validated on a large, real-world patient dataset. Both the 14 and 5-feature versions exhibit high performance. CONCLUSION: The NASHmap model is a convenient and high performing tool that could be used to identify patients likely to have NASH in clinical settings, allowing better patient management and optimal allocation of clinical resources.