Causal fairness assessment of treatment allocation with electronic health records.

OBJECTIVE: Healthcare continues to grapple with the persistent issue of treatment disparities, sparking concerns regarding the equitable allocation of treatments in clinical practice. While various fairness metrics have emerged to assess fairness in decision-making processes, a growing focus has been on causality-based fairness concepts due to their capacity to mitigate confounding effects and reason about bias. However, the application of causal fairness notions in evaluating the fairness of clinical decision-making with electronic health record (EHR) data remains an understudied domain. This study aims to address the methodological gap in assessing causal fairness of treatment allocation with electronic health records data. In addition, we investigate the impact of social determinants of health on the assessment of causal fairness of treatment allocation. METHODS: We propose a causal fairness algorithm to assess fairness in clinical decision-making. Our algorithm accounts for the heterogeneity of patient populations and identifies potential unfairness in treatment allocation by conditioning on patients who have the same likelihood to benefit from the treatment. We apply this framework to a patient cohort with coronary artery disease derived from an EHR database to evaluate the fairness of treatment decisions. RESULTS: Our analysis reveals notable disparities in coronary artery bypass grafting (CABG) allocation among different patient groups. Women were found to be 4.4%-7.7% less likely to receive CABG than men in two out of four treatment response strata. Similarly, Black or African American patients were 5.4%-8.7% less likely to receive CABG than others in three out of four response strata. These results were similar when social determinants of health (insurance and area deprivation index) were dropped from the algorithm. These findings highlight the presence of disparities in treatment allocation among similar patients, suggesting potential unfairness in the clinical decision-making process. CONCLUSION: This study introduces a novel approach for assessing the fairness of treatment allocation in healthcare. By incorporating responses to treatment into fairness framework, our method explores the potential of quantifying fairness from a causal perspective using EHR data. Our research advances the methodological development of fairness assessment in healthcare and highlight the importance of causality in determining treatment fairness.

Evaluating and Improving the Performance and Racial Fairness of Algorithms for GFR Estimation.

Data-driven clinical prediction algorithms are used widely by clinicians. Understanding what factors can impact the performance and fairness of data-driven algorithms is an important step towards achieving equitable healthcare. To investigate the impact of modeling choices on the algorithmic performance and fairness, we make use of a case study to build a prediction algorithm for estimating glomerular filtration rate (GFR) based on the patient's electronic health record (EHR). We compare three distinct approaches for estimating GFR: CKD-EPI equations, epidemiological models, and EHR-based models. For epidemiological models and EHR-based models, four machine learning models of varying computational complexity (i.e., linear regression, support vector machine, random forest regression, and neural network) were compared. Performance metrics included root mean squared error (RMSE), median difference, and the proportion of GFR estimates within 30% of the measured GFR value (P30). Differential performance between non-African American and African American group was used to assess algorithmic fairness with respect to race. Our study showed that the variable race had a negligible effect on error, accuracy, and differential performance. Furthermore, including more relevant clinical features (e.g., common comorbidities of chronic kidney disease) and using more complex machine learning models, namely random forest regression, significantly lowered the estimation error of GFR. However, the difference in performance between African American and non-African American patients did not decrease, where the estimation error for African American patients remained consistently higher than non-African American patients, indicating that more objective patient characteristics should be discovered and included to improve algorithm performance.

Scalable and interpretable alternative to chart review for phenotype evaluation using standardized structured data from electronic health records.

OBJECTIVES: Chart review as the current gold standard for phenotype evaluation cannot support observational research on electronic health records and claims data sources at scale. We aimed to evaluate the ability of structured data to support efficient and interpretable phenotype evaluation as an alternative to chart review. MATERIALS AND METHODS: We developed Knowledge-Enhanced Electronic Profile Review (KEEPER) as a phenotype evaluation tool that extracts patient's structured data elements relevant to a phenotype and presents them in a standardized fashion following clinical reasoning principles. We evaluated its performance (interrater agreement, intermethod agreement, accuracy, and review time) compared to manual chart review for 4 conditions using randomized 2-period, 2-sequence crossover design. RESULTS: Case ascertainment with KEEPER was twice as fast compared to manual chart review. 88.1% of the patients were classified concordantly using charts and KEEPER, but agreement varied depending on the condition. Missing data and differences in interpretation accounted for most of the discrepancies. Pairs of clinicians agreed in case ascertainment in 91.2% of the cases when using KEEPER compared to 76.3% when using charts. Patient classification aligned with the gold standard in 88.1% and 86.9% of the cases respectively. CONCLUSION: Structured data can be used for efficient and interpretable phenotype evaluation if they are limited to relevant subset and organized according to the clinical reasoning principles. A system that implements these principles can achieve noninferior performance compared to chart review at a fraction of time.

A metadata framework for computational phenotypes.

With the burgeoning development of computational phenotypes, it is increasingly difficult to identify the right phenotype for the right tasks. This study uses a mixed-methods approach to develop and evaluate a novel metadata framework for retrieval of and reusing computational phenotypes. Twenty active phenotyping researchers from 2 large research networks, Electronic Medical Records and Genomics and Observational Health Data Sciences and Informatics, were recruited to suggest metadata elements. Once consensus was reached on 39 metadata elements, 47 new researchers were surveyed to evaluate the utility of the metadata framework. The survey consisted of 5-Likert multiple-choice questions and open-ended questions. Two more researchers were asked to use the metadata framework to annotate 8 type-2 diabetes mellitus phenotypes. More than 90% of the survey respondents rated metadata elements regarding phenotype definition and validation methods and metrics positively with a score of 4 or 5. Both researchers completed annotation of each phenotype within 60 min. Our thematic analysis of the narrative feedback indicates that the metadata framework was effective in capturing rich and explicit descriptions and enabling the search for phenotypes, compliance with data standards, and comprehensive validation metrics. Current limitations were its complexity for data collection and the entailed human costs.

Data assimilation on mechanistic models of glucose metabolism predicts glycemic states in adolescents following bariatric surgery.

Type 2 diabetes mellitus is a complex and under-treated disorder closely intertwined with obesity. Adolescents with severe obesity and type 2 diabetes have a more aggressive disease compared to adults, with a rapid decline in pancreatic ß cell function and increased incidence of comorbidities. Given the relative paucity of pharmacotherapies, bariatric surgery has become increasingly used as a therapeutic option. However, subsets of this population have sub-optimal outcomes with either inadequate weight loss or little improvement in disease. Predicting which patients will benefit from surgery is a difficult task and detailed physiological characteristics of patients who do not respond to treatment are generally unknown. Identifying physiological predictors of surgical response therefore has the potential to reveal both novel phenotypes of disease as well as therapeutic targets. We leverage data assimilation paired with mechanistic models of glucose metabolism to estimate pre-operative physiological states of bariatric surgery patients, thereby identifying latent phenotypes of impaired glucose metabolism. Specifically, maximal insulin secretion capacity, σ, and insulin sensitivity, SI, differentiate aberrations in glucose metabolism underlying an individual's disease. Using multivariable logistic regression, we combine clinical data with data assimilation to predict post-operative glycemic outcomes at 12 months. Models using data assimilation sans insulin had comparable performance to models using oral glucose tolerance test glucose and insulin. Our best performing models used data assimilation and had an area under the receiver operating characteristic curve of 0.77 (95% confidence interval 0.7665, 0.7734) and mean average precision of 0.6258 (0.6206, 0.6311). We show that data assimilation extracts knowledge from mechanistic models of glucose metabolism to infer future glycemic states from limited clinical data. This method can provide a pathway to predict long-term, post-surgical glycemic states by estimating the contributions of insulin resistance and limitations of insulin secretion to pre-operative glucose metabolism.

Targeted Delivery of Notch Inhibitor Attenuates Obesity-Induced Glucose Intolerance and Liver Fibrosis.

As the prevalence of obesity-induced type 2 diabetes mellitus (T2DM) and nonalcoholic steatohepatitis (NASH) continue to increase, the need for pharmacologic therapies becomes urgent. However, endeavors to identify and develop novel therapeutic strategies for these chronic conditions are balanced by the need for safety, impeding clinical translation. One shared pathology of these two diseases is a maladaptive reactivation of the Notch signaling pathway in liver. Notch antagonism with γ-secretase inhibitors effectively suppresses hepatic glucose production and reduces liver fibrosis in NASH, but its extrahepatic side effects, particularly goblet cell metaplasia, limit therapeutic utility. To overcome this barrier, we developed a nanoparticle-mediated delivery system to target γ-secretase inhibitor to liver (GSI NPs). GSI NP application reduced hepatic glucose production in diet-induced obese mice and reduced hepatic fibrosis and inflammation in mice fed a NASH-provoking diet, without apparent gastrointestinal toxicity. By changing the delivery method, these results provide proof-of-concept for the repurposing of a previously intolerable medication to address unmet needs in the clinical landscape for obesity-induced T2DM and NASH.