Fitness-for-use of Retrospective Multicenter Electronic Health Records to Conduct Outcome Analysis for Pediatric Ulcerative Colitis.

The use of electronic health records has garnered interest as an approach for conducting innovative outcome research and producing real-world evidence at a reduced cost compared to traditional clinical trials. The study aimed to evaluate the utility of deidentified EHR data from a multicenter research network to identify characteristics associated with treatment escalation (TE) in newly diagnosed pediatric ulcerative colitis patients. EHR data (01/2010-12/2021) from 13 Midwest healthcare systems (Greater Plains Collaborative) were collected for pediatric ulcerative colitis patients. We identified standard treatments, excluded missing initial therapy data, and analyzed the TE and time-to-TE outcomes. The clinical and laboratory characteristics at baseline were extracted. Logistic and Cox models were used, and the missing risk factors were imputed. Machine-learning Bayesian additive regression trees were also utilized to create partial dependence plots for assessing the associations between risk factors and clinical outcomes. A total of 502 eligible pediatric patients (aged 4-17 years) who initiated standard treatment were identified. Among them, 205 out of 502 (41%) experienced TE, with a median (P25, P75) duration of 63 (9, 237) days after the initial treatment. Additionally, 20 out of 509 (4%) patients underwent colectomy (COL) with a median (P25, P75) duration of 80 (3, 205) days. Both multivariable logistic regression and Cox proportional hazards regression demonstrated moderate discriminative power in predicting TE and time-to-TE, respectively. Common positive predictors for both TE and time-to-TE included a high monocyte proportion and elevated platelet counts. Conversely, BMI z-score, albumin, hemoglobin levels, and lymphocyte proportion were negatively associated with both TE and time-to-TE. This study demonstrates that multicenter EHR data can be used to identify a trial-comparable study sample of potentially larger size and to identify clinically meaningful endpoints for conducting outcome analysis and generating real-world evidence.

Design of a pragmatic randomized implementation effectiveness trial testing a health system wide hypertension program for older adults.

Hypertension control remains poor. Multiple barriers at the level of patients, providers, and health systems interfere with implementation of hypertension guidelines and effective lowering of BP. Some strategies such as self-measured blood pressure (SMBP) and remote management by pharmacists are safe and effectively lower BP but have not been effectively implemented. In this study, we combine such evidence-based strategies to build a remote hypertension program and test its effectiveness and implementation in large health systems. This randomized, controlled, pragmatic type I hybrid implementation effectiveness trial will examine the virtual collaborative care clinic (vCCC), a hypertension program that integrates automated patient identification, SMBP, remote BP monitoring by trained health system pharmacists, and frequent patient-provider communication. We will randomize 1000 patients with uncontrolled hypertension from two large health systems in a 1:1 ratio to either vCCC or control (usual care with education) groups for a 2-year intervention. Outcome measures including BP measurements, cognitive function, and a symptom checklist will be completed during study visits. Other outcome measures of cardiovascular events, mortality, and health care utilization will be assessed using Medicare data. For the primary outcome of proportion achieving BP control (defined as systolic BP < 130 mmHg) in the two groups, we will use a generalized linear mixed model analysis. Implementation outcomes include acceptability and feasibility of the program. This study will guide implementation of a hypertension program within large health systems to effectively lower BP.

Positive Airway Pressure Therapy Predicts Lower Mortality and Major Adverse Cardiovascular Events Incidence in Medicare Beneficiaries with Obstructive Sleep Apnea.

Background: Obesity is associated with obstructive sleep apnea (OSA) and cardiovascular risk. Positive airway pressure (PAP) is the first line treatment for OSA, but evidence on its beneficial effect on major adverse cardiovascular events (MACE) prevention is limited. Using claims data, the effects of PAP on mortality and incidence of MACE among Medicare beneficiaries with OSA were examined. Methods: A cohort of Medicare beneficiaries with ≥2 distinct OSA claims was defined from multi-state, state-wide, multi-year (2011-2020) Medicare fee-for-service claims data. Evidence of PAP initiation and utilization was based on PAP claims after OSA diagnosis. MACE was defined as a composite of myocardial infarction, heart failure, stroke, or coronary revascularization. Doubly robust Cox proportional hazards models with inverse probability of treatment weights estimated treatment effects controlling for sociodemographic and clinical factors. Results: Among 888,835 beneficiaries with OSA (median age 73 years; 43.9% women; median follow-up 1,141 days), those with evidence of PAP initiation (32.6%) had significantly lower all-cause mortality (HR [95%CI]: 0.53 [0.52-0.54]) and MACE incidence risk (0.90 [0.89-0.91]). Higher quartiles of annual PAP claims were progressively associated with lower mortality (Q2: 0.84 [0.81-0.87], Q3: 0.76 [0.74-0.79], Q4: 0.74 [0.72-0.77]) and MACE incidence risk (Q2: 0.92 [0.89-0.95], Q3: 0.89 [0.86-0.91], Q4: 0.87 [0.85-0.90]). Conclusion: PAP utilization was associated with lower all-cause mortality and MACE incidence among Medicare beneficiaries with OSA. Results might inform trials assessing the importance of OSA therapy towards minimizing cardiovascular risk and mortality in older adults.

Avenues for Strengthening PCORnet's Capacity to Advance Patient-Centered Economic Outcomes in Patient-Centered Outcomes Research (PCOR).

PCORnet, the National Patient-Centered Clinical Research Network, provides the ability to conduct prospective and observational pragmatic research by leveraging standardized, curated electronic health records data together with patient and stakeholder engagement. PCORnet is funded by the Patient-Centered Outcomes Research Institute (PCORI) and is composed of 8 Clinical Research Networks that incorporate at total of 79 health system "sites." As the network developed, linkage to commercial health plans, federal insurance claims, disease registries, and other data resources demonstrated the value in extending the networks infrastructure to provide a more complete representation of patient's health and lived experiences. Initially, PCORnet studies avoided direct economic comparative effectiveness as a topic. However, PCORI's authorizing law was amended in 2019 to allow studies to incorporate patient-centered economic outcomes in primary research aims. With PCORI's expanded scope and PCORnet's phase 3 beginning in January 2022, there are opportunities to strengthen the network's ability to support economic patient-centered outcomes research. This commentary will discuss approaches that have been incorporated to date by the network and point to opportunities for the network to incorporate economic variables for analysis, informed by patient and stakeholder perspectives. Topics addressed include: (1) data linkage infrastructure; (2) commercial health plan partnerships; (3) Medicare and Medicaid linkage; (4) health system billing-based benchmarking; (5) area-level measures; (6) individual-level measures; (7) pharmacy benefits and retail pharmacy data; and (8) the importance of transparency and engagement while addressing the biases inherent in linking real-world data sources.

Medications and conditions associated with weight loss in patients prescribed semaglutide based on real-world data.

OBJECTIVE: Approved by the Food and Drug Administration (FDA) in 2017 for diabetes and in 2021 for weight loss, semaglutide has seen widespread use among individuals who aim to lose weight. The aim of this study was to evaluate weight loss and the influence of clinical factors on semaglutide patients in real-world clinical practice. METHODS: Using data from 10 health systems within the Greater Plains Collaborative (a PCORnet Clinical Research Network), nearly 4000 clinical factors encompassing demographic, diagnosis, and prescription information were extracted for semaglutide patients. A gradient-boosting, machine-learning classifier was developed for weight-loss prediction and identification of the most impactful factors via SHapley Additive exPlanations (SHAP) value extrapolation. RESULTS: A total of 3555 eligible patients (539 of whom were observed 52 weeks following exposure) from March 2017 to April 2022 were studied. On average, individuals lost 4.44% (male individuals, 3.66%; female individuals, 5.08%) of their initial weight. History of diabetes mellitus diagnosis was associated with less weight loss, whereas prediabetes and linaclotide use were associated with more pronounced weight loss. CONCLUSIONS: Weight loss in patients prescribed semaglutide from real-world evidence was strong but attenuated compared with previous clinical trials. Machine-learning analysis of electronic health record data identified factors that warrant further research and consideration when tailoring weight-loss therapy.

Electronic health record data quality variability across a multistate clinical research network.

Background: Electronic health record (EHR) data have many quality problems that may affect the outcome of research results and decision support systems. Many methods have been used to evaluate EHR data quality. However, there has yet to be a consensus on the best practice. We used a rule-based approach to assess the variability of EHR data quality across multiple healthcare systems. Methods: To quantify data quality concerns across healthcare systems in a PCORnet Clinical Research Network, we used a previously tested rule-based framework tailored to the PCORnet Common Data Model to perform data quality assessment at 13 clinical sites across eight states. Results were compared with the current PCORnet data curation process to explore the differences between both methods. Additional analyses of testosterone therapy prescribing were used to explore clinical care variability and quality. Results: The framework detected discrepancies across sites, revealing evident data quality variability between sites. The detailed requirements encoded the rules captured additional data errors with a specificity that aids in remediation of technical errors compared to the current PCORnet data curation process. Other rules designed to detect logical and clinical inconsistencies may also support clinical care variability and quality programs. Conclusion: Rule-based EHR data quality methods quantify significant discrepancies across all sites. Medication and laboratory sources are causes of data errors.

Enrichment of a Data Lake to Support Population Health Outcomes Studies Using Social Determinants Linked EHR Data.

The integration of electronic health records (EHRs) with social determinants of health (SDoH) is crucial for population health outcome research, but it requires the collection of identifiable information and poses security risks. This study presents a framework for facilitating de-identified clinical data with privacy-preserved geocoded linked SDoH data in a Data Lake. A reidentification risk detection algorithm was also developed to evaluate the transmission risk of the data. The utility of this framework was demonstrated through one population health outcomes research analyzing the correlation between socioeconomic status and the risk of having chronic conditions. The results of this study inform the development of evidence-based interventions and support the use of this framework in understanding the complex relationships between SDoH and health outcomes. This framework reduces computational and administrative workload and security risks for researchers and preserves data privacy and enables rapid and reliable research on SDoH-connected clinical data for research institutes.

Evaluation of weight change and cardiometabolic risk factors in a real-world population of US adults with overweight or obesity.

Whether individuals in real-world settings are able to lose weight and improve cardiometabolic risk factors over time is unclear. We aimed to determine the management of and degree of body weight change over 2 years among individuals with overweight or obesity, and to assess associated changes in cardiometabolic risk factors and clinical outcomes. Using data from 11 large health systems within the Patient-Centered Outcomes Research Network in the U.S., we collected the following data on adults with a recorded BMI ≥25 kg/m2 between January 1, 2016 and December 31, 2016: body-mass index (BMI), systolic blood pressure (SBP), diastolic blood pressure (DBP), low-density lipoprotein cholesterol (LDL-C), high-density lipoprotein cholesterol (HDLC), triglycerides and glycated hemoglobin (HbA1c). We found that among 882,712 individuals with BMI ≥25 kg/m2 (median age 59 years; 56% female), 52% maintained stable weight over 2 years and 1.3% utilized weight loss pharmacotherapy. Weight loss of 10% was associated with small but significant lowering of mean SBP (-2.69 mmHg [95% CI -2.88, -2.50]), DBP (-1.26 mmHg [95% CI -1.35, -1.18]), LDL-C (-2.60 mg/dL [95% CI -3.14, -2.05]), and HbA1c (-0.27% [95% CI -0.35, -0.19]) in the same 12 months. However, these changes were not sustained over the following year. In this study of adults with BMI ≥25 kg/m2, the majority had stable weight over 2 years, pharmacotherapies for weight loss were under-used, and small changes in cardiometabolic risk factors with weight loss were not sustained, possibly due to failure to maintain weight loss.

Implementing a home-based virtual hypertension programme-a pilot feasibility study.

INTRODUCTION: Implementing a health system-based hypertension programme may lower blood pressure (BP). METHODS: We performed a randomized, controlled pilot study to assess feasibility, acceptability, and safety of a home-based virtual hypertension programme integrating evidence-based strategies to overcome current barriers to BP control. Trained clinical pharmacists staffed the virtual collaborative care clinic (vCCC) to remotely manage hypertension using a BP dashboard and phone "visits" to monitor BP, adherence, side effects of medications, and prescribe anti-hypertensives. Patients with uncontrolled hypertension were identified via electronic health records. Enrolled patients were randomized to either vCCC or usual care for 3 months. We assessed patients' home BP monitoring behaviour, and patients', physicians', and pharmacists' perspectives on feasibility and acceptability of individual programme components. RESULTS: Thirty-one patients (vCCC = 17, usual care = 14) from six physician clinics completed the pilot study. After 3 months, average BP decreased in the vCCC arm (P = 0.01), but not in the control arm (P = 0.45). The vCCC participants measured BP more (9.9 vs. 1.2 per week, P < 0.001). There were no intervention-related adverse events. Participating physicians (n = 6), pharmacists (n = 5), and patients (n = 31) rated all programme components with average scores of >4.0, a pre-specified benchmark. Nine adaptations in vCCC design and delivery were made based on potential barriers to implementing the programme and suggestions. CONCLUSION: A home-based virtual hypertension programme using team-based care, technology, and a logical integration of evidence-based strategies is safe, acceptable, and feasible to intended users. These pilot data support studies to assess the effectiveness of this programme at a larger scale.

Mapping Clinical Documents to the Logical Observation Identifiers, Names and Codes (LOINC) Document Ontology using Electronic Health Record Systems Structured Metadata.

As Electronic Health Record (EHR) systems increase in usage, organizations struggle to maintain and categorize clinical documentation so it can be used for clinical care and research. While prior research has often employed natural language processing techniques to categorize free text documents, there are shortcomings relative to computational scalability and the lack of key metadata within notes' text. This study presents a framework that can allow institutions to map their notes to the LOINC document ontology using a Bag of Words approach. After preliminary manual value- set mapping, an automated pipeline that leverages key dimensions of metadata from structured EHR fields aligns the notes with the dimensions of the document ontology. This framework resulted in 73.4% coverage of EHR documents, while also mapping 132 million notes in less than 2 hours; an order of magnitude more efficient than NLP based methods.

Standardizing Multi-site Clinical Note Titles to LOINC Document Ontology: A Transformer-based Approach.

The types of clinical notes in electronic health records (EHRs) are diverse and it would be great to standardize them to ensure unified data retrieval, exchange, and integration. The LOINC Document Ontology (DO) is a subset of LOINC that is created specifically for naming and describing clinical documents. Despite the efforts of promoting and improving this ontology, how to efficiently deploy it in real-world clinical settings has yet to be explored. In this study we evaluated the utility of LOINC DO by mapping clinical note titles collected from five institutions to the LOINC DO and classifying the mapping into three classes based on semantic similarity between note titles and LOINC DO codes. Additionally, we developed a standardization pipeline that automatically maps clinical note titles from multiple sites to suitable LOINC DO codes, without accessing the content of clinical notes. The pipeline can be initialized with different large language models, and we compared the performances between them. The results showed that our automated pipeline achieved an accuracy of 0.90. By comparing the manual and automated mapping results, we analyzed the coverage of LOINC DO in describing multi-site clinical note titles and summarized the potential scope for extension.

Natural Language Processing for Enterprise-scale De-identification of Protected Health Information in Clinical Notes.

Patient privacy is a major concern when allowing data sharing and the flow of health information. Hence, de-identification and anonymization techniques are used to ensure the protection of patient health information while supporting the secondary uses of data to advance the healthcare system and improve patient outcomes. Several de-identification tools have been developed for free-text, however, this research focuses on developing notes de-identification and adjudication framework that has been tested for i2b2 searches. The aim is to facilitate clinical notes research without an additional HIPAA approval process or consent by a clinician or patient especially for narrative free-text notes such as physician and nursing notes. In this paper, we build a scalable, accurate, and maintainable pipeline for notes de-identification utilizing the natural language processing and REDCap database as a method of adjudication verification. The system is deployed at an enterprise-scale where researchers can search and visualize over 45 million de-identified notes hosted in an i2b2 instance.

A secondary analysis of PAIN-CONTRoLS: Pain's impact on sleep, fatigue, and activities of daily living.

INTRODUCTION/AIMS: Peripheral neuropathies commonly affect quality of life of patients due to pain, sleep disturbances, and fatigue, although trials have not adequately explored these domains of care. The aim of this study was to assess the impact of nortriptyline, duloxetine, pregabalin, and mexiletine on pain, sleep, and fatigue in patients diagnosed with cryptogenic sensory polyneuropathy (CSPN). METHODS: We implemented a Bayesian adaptive design to perform a 12-wk multisite, randomized, prospective, open-label comparative effectiveness study in 402 CSPN patients. Participants received either nortriptyline (n = 134), duloxetine (n = 126), pregabalin (n = 73), or mexiletine (n = 69). At prespecified analysis timepoints, secondary outcomes, Patient Reported Outcomes Measurement Information System (PROMIS) surveys including Short Form (SF)-12, pain interference, fatigue, and sleep disturbance, were collected. RESULTS: Mexiletine had the highest quit rate (58%) due to gastrointestinal side effects, while nortriptyline (38%) and duloxetine (38%) had the lowest quit rates. If tolerated for the full 12 wk of the study, mexiletine had the highest probability (>90%) of positive outcomes for improvements in pain interference and fatigue. There was no significant difference among the medications for sleep disturbance or SF-12 scores. Adverse events and lack of efficacy were the two most common reasons for cessation of therapy. DISCUSSION: Physicians caring for patients with CSPN should consider mexiletine to address pain and fatigue, although nortriptyline and duloxetine are better medications to trial first since they are better tolerated. Future research should compare other commonly used medications for CSPN to determine evidence-based treatment strategies.

Enhancing PCORnet Clinical Research Network data completeness by integrating multistate insurance claims with electronic health records in a cloud environment aligned with CMS security and privacy requirements.

OBJECTIVE: The Greater Plains Collaborative (GPC) and other PCORnet Clinical Data Research Networks capture healthcare utilization within their health systems. Here, we describe a reusable environment (GPC Reusable Observable Unified Study Environment [GROUSE]) that integrates hospital and electronic health records (EHRs) data with state-wide Medicare and Medicaid claims and assess how claims and clinical data complement each other to identify obesity and related comorbidities in a patient sample. MATERIALS AND METHODS: EHR, billing, and tumor registry data from 7 healthcare systems were integrated with Center for Medicare (2011-2016) and Medicaid (2011-2012) services insurance claims to create deidentified databases in Informatics for Integrating Biology & the Bedside and PCORnet Common Data Model formats. We describe technical details of how this federally compliant, cloud-based data environment was built. As a use case, trends in obesity rates for different age groups are reported, along with the relative contribution of claims and EHR data-to-data completeness and detecting common comorbidities. RESULTS: GROUSE contained 73 billion observations from 24 million unique patients (12.9 million Medicare; 13.9 million Medicaid; 6.6 million GPC patients) with 1 674 134 patients crosswalked and 983 450 patients with body mass index (BMI) linked to claims. Diagnosis codes from EHR and claims sources underreport obesity by 2.56 times compared with body mass index measures. However, common comorbidities such as diabetes and sleep apnea diagnoses were more often available from claims diagnoses codes (1.6 and 1.4 times, respectively). CONCLUSION: GROUSE provides a unified EHR-claims environment to address health system and federal privacy concerns, which enables investigators to generalize analyses across health systems integrated with multistate insurance claims.

Tailoring Rule-Based Data Quality Assessment to the Patient-Centered Outcomes Research Network (PCORnet) Common Data Model (CDM).

Individual researchers and research networks have developed and applied different approaches to assess the data quality of electronic health record (EHR) data. A previously published rules-based method to evaluate the data quality of EHR data provides deeper levels of data quality analysis. To examine the effectiveness and generalizability of the rule-based framework, we reprogrammed and translated published rule templates to operate against the PCORnet Common Data Model and executed them against a database for a single center of the Greater Plains Collaborative (GPC) PCORnet Clinical Research Network. The framework detected additional data errors and logical inconsistencies not revealed by current data quality procedures. Laboratory and medication data were more vulnerable to errors. Hemolyzed samples in the emergency department and metformin prescribing in ambulatory clinics are further described to illustrate application of specific rule-based findings by researchers to engage their health systems in evaluating healthcare delivery and clinical quality concerns.

Clinical factors associated with rapid treatment of sepsis.

PURPOSE: To understand what clinical presenting features of sepsis patients are historically associated with rapid treatment involving antibiotics and fluids, as appropriate. DESIGN: This was a retrospective, observational cohort study using a machine-learning model with an embedded feature selection mechanism (gradient boosting machine). METHODS: For adult patients (age ≥ 18 years) who were admitted through Emergency Department (ED) meeting clinical criteria of severe sepsis from 11/2007 to 05/2018 at an urban tertiary academic medical center, we developed gradient boosting models (GBMs) using a total of 760 original and derived variables, including demographic variables, laboratory values, vital signs, infection diagnosis present on admission, and historical comorbidities. We identified the most impactful factors having strong association with rapid treatment, and further applied the Shapley Additive exPlanation (SHAP) values to examine the marginal effects for each factor. RESULTS: For the subgroups with or without fluid bolus treatment component, the models achieved high accuracy of area-under-receiver-operating-curve of 0.91 [95% CI, 0.86-0.95] and 0.84 [95% CI, 0.81-0.86], and sensitivity of 0.81[95% CI, 0.72-0.87] and 0.91 [95% CI, 0.81-0.97], respectively. We identified the 20 most impactful factors associated with rapid treatment for each subgroup. In the non-hypotensive subgroup, initial physiological values were the most impactful to the model, while in the fluid bolus subgroup, value minima and maxima tended to be the most impactful. CONCLUSION: These machine learning methods identified factors associated with rapid treatment of severe sepsis patients from a large volume of high-dimensional clinical data. The results provide insight into differences in the rapid provision of treatment among patients with sepsis.

The effect of age and gender on acute postoperative pain and function following lumbar spine surgeries.

BACKGROUND AND PURPOSE: Understanding the factors contributing to the variability in postoperative pain and function following lumbar spine surgeries (LSS) is necessary to plan inpatient rehabilitation and optimize surgical outcomes. In particular, variability due to age and gender has not been studied. This study's aim was to evaluate the variability in postoperative pain and function, during hospital stay, due to age and gender following LSS. METHODS: We conducted a retrospective analysis of 585 patients who underwent LSS during their hospital stay. Univariate ANCOVA was performed to study the differences in postoperative pain, and multivariate ANCOVA was performed to study the differences in postoperative function (gait distance, independency combined score, and balance combined score) between age groups (older adults [≥65 years of age] vs. younger adults) and gender. RESULTS: Younger patients reported statistically, but not clinically, significant higher postoperative pain than older patients (ß = 0.652 [95% CI (0.382-0.986)], p < 0.001), and males reported statistically, but not clinically, significant lower postoperative pain than female patients (ß = -0.583 [95% CI (-0.825 to -0.252)], p < 0.001) with adjustment of covariates. Male patients walked significantly longer distance than female patients (ß = 0.272 [95% CI (0.112-0.432)], p = 0.001) with adjustment of covariates. However, these were clinically insignificant. With adjustment of preoperative diagnosis, type of surgery, severity of illness, and prior level of function, there was no statistically significant difference between age groups in walking distance, and between age and gender groups in independency combined score and balance combined scores. DISCUSSION: Following LSS, the difference in postoperative pain between age groups and gender are statistically but not clinically significant, suggesting patients require similar effective postoperative pain management regardless of age and gender. The apparent difference in age and gender in postoperative functional outcomes could be due to other factors.

Cross-site transportability of an explainable artificial intelligence model for acute kidney injury prediction.

Artificial intelligence (AI) has demonstrated promise in predicting acute kidney injury (AKI), however, clinical adoption of these models requires interpretability and transportability. Non-interoperable data across hospitals is a major barrier to model transportability. Here, we leverage the US PCORnet platform to develop an AKI prediction model and assess its transportability across six independent health systems. Our work demonstrates that cross-site performance deterioration is likely and reveals heterogeneity of risk factors across populations to be the cause. Therefore, no matter how accurate an AI model is trained at the source hospital, whether it can be adopted at target hospitals is an unanswered question. To fill the research gap, we derive a method to predict the transportability of AI models which can accelerate the adaptation process of external AI models in hospitals.