Kidney and Cardiovascular Effectiveness of Empagliflozin Compared With Dipeptidyl Peptidase-4 Inhibitors in Patients With Type 2 Diabetes.

Placebo-controlled trials of sodium-glucose co-transporter-2 inhibitors demonstrate kidney and cardiovascular benefits for patients with type 2 diabetes and chronic kidney disease (CKD). We used real-world data to compare the kidney and cardiovascular effectiveness of empagliflozin to dipeptidyl peptidase-4 inhibitors (DPP4is), a commonly prescribed antiglycemic medication, in a diverse population with and without CKD. Using electronic health record data from 20 large US health systems, we leveraged propensity overlap weighting to compare the outcomes for empagliflozin and DPP4i initiators with type 2 diabetes between 2016 and 2020. The primary composite kidney outcome included 40% estimated glomerular filtration rate decrease, incident end-stage kidney disease, or all-cause mortality through 2 years or censoring. We also assessed cardiovascular and safety outcomes. Of 62,197 new users, 20,279 initiated empagliflozin and 41,918 initiated DPP4i. Over a median follow-up of 1.1 years, empagliflozin prescription was associated with a lower risk of the primary outcome (hazard ratio [HR] 0.75, 95% confidence interval [CI] 0.65 to 0.87) than DPP4is. The risks for mortality (HR 0.76, 95% CI 0.62 to 0.92) and a cardiovascular composite of stroke, myocardial infarction, or all-cause mortality (HR 0.81, 95% CI 0.70 to 0.95) were also lower for empagliflozin initiators. No difference in heart failure hospitalization risk between groups was observed. Genital mycotic infections were more common in patients prescribed empagliflozin (HR 1.72, 95% CI 1.58 to 1.88). Empagliflozin was associated with a lower risk of the primary outcome in patients with CKD (HR 0.68, 95% CI 0.53 to 0.88) and those without CKD (HR 0.79, 95% CI 0.67 to 0.94). In conclusion, the initiation of empagliflozin was associated with a significantly lower risk of kidney and cardiovascular outcomes than DPP4is over a median of just over 1 year. The association with a lower risk for clinical outcomes was apparent even for patients without known CKD at baseline.

Collecting patient-reported outcome measures in the electronic health record: Lessons from the NIH pragmatic trials Collaboratory.

The NIH Pragmatic Trials Collaboratory supports the design and conduct of 27 embedded pragmatic clinical trials, and many of the studies collect patient reported outcome measures as primary or secondary outcomes. Study teams have encountered challenges in the collection of these measures, including challenges related to competing health care system priorities, clinician's buy-in for adoption of patient-reported outcome measures, low adoption and reach of technology in low resource settings, and lack of consensus and standardization of patient-reported outcome measure selection and administration in the electronic health record. In this article, we share case examples and lessons learned, and suggest that, when using patient-reported outcome measures for embedded pragmatic clinical trials, investigators must make important decisions about whether to use data collected from the participating health system's electronic health record, integrate externally collected patient-reported outcome data into the electronic health record, or collect these data in separate systems for their studies.

Optimizing data integration in trials that use EHR data: lessons learned from a multi-center randomized clinical trial.

BACKGROUND: Despite great promise, trials that ascertain patient clinical data from electronic health records (EHR), referred to here as "EHR-sourced" trials, are limited by uncertainty about how existing trial sites and infrastructure can be best used to operationalize study goals. Evidence is needed to support the practical use of EHRs in contemporary clinical trial settings. MAIN TEXT: We describe a demonstration project that used EHR data to complement data collected for a contemporary multi-center pharmaceutical industry outcomes trial, and how a central coordinating center supported participating sites through the technical, governance, and operational aspects of this type of activity. We discuss operational considerations related to site selection, data extraction, site performance, and data transfer and quality review, and we outline challenges and lessons learned. We surveyed potential sites and used their responses to assess feasibility, determine the potential capabilities of sites and choose an appropriate data extraction strategy. We designed a flexible, multimodal approach for data extraction, enabling each site to either leverage an existing data source, create a new research datamart, or send all data to the central coordinating center to produce the requisite data elements. We evaluated site performance, as reflected by the speed of contracting and IRB approval, total patients enrolled, enrollment yield, data quality, and compared performance by data collection strategy. CONCLUSION: While broadening the type of sites able to participate in EHR-sourced trials may lead to greater generalizability and improved enrollment, sites with fewer technical resources may require additional support to participate. Central coordinating center support is essential to facilitate the execution of operational processes. Future work should focus on sharing lessons learned and creating reusable tools to facilitate participation of heterogeneous trial sites.

Potential bias and lack of generalizability in electronic health record data: reflections on health equity from the National Institutes of Health Pragmatic Trials Collaboratory.

Embedded pragmatic clinical trials (ePCTs) play a vital role in addressing current population health problems, and their use of electronic health record (EHR) systems promises efficiencies that will increase the speed and volume of relevant and generalizable research. However, as the number of ePCTs using EHR-derived data grows, so does the risk that research will become more vulnerable to biases due to differences in data capture and access to care for different subsets of the population, thereby propagating inequities in health and the healthcare system. We identify 3 challenges-incomplete and variable capture of data on social determinants of health, lack of representation of vulnerable populations that do not access or receive treatment, and data loss due to variable use of technology-that exacerbate bias when working with EHR data and offer recommendations and examples of ways to actively mitigate bias.

Cardiology Encounters for Underrepresented Racial and Ethnic Groups with Human Immunodeficiency Virus and Borderline Cardiovascular Disease Risk.

BACKGROUND: Underrepresented racial and ethnic groups (UREGs) with HIV have a higher risk of cardiovascular disease (CVD) compared with the general population. Referral to a cardiovascular specialist improves CVD risk factor management in high-risk individuals. However, patient and provider factors impacting the likelihood of UREGs with HIV to have an encounter with a cardiologist are unknown. METHODS: We evaluated a cohort of UREGs with HIV and borderline CVD risk (10-year risk ≥ 5% by the pooled cohort equations or ≥ 7.5% by Framingham risk score). Participants received HIV-related care from 2014-2020 at four academic medical centers in the United States (U.S.). Adjusted Cox proportional hazards regression was used to estimate the association of patient and provider characteristics with time to first ambulatory cardiology encounter. RESULTS: A total of 2,039 people with HIV (PWH) and borderline CVD risk were identified. The median age was 45 years (IQR: 36-50); 52% were female; and 94% were Black. Of these participants, 283 (14%) had an ambulatory visit with a cardiologist (17% of women vs. 11% of men, p < .001). In fully adjusted models, older age, higher body mass index (BMI), atrial fibrillation, multimorbidity, urban residence, and no recent insurance were associated with a greater likelihood of an encounter with a cardiologist. CONCLUSION: In UREGs with HIV and borderline CVD risk, the strongest determinants of a cardiology encounter were diagnosed CVD, insurance type, and urban residence. Future research is needed to determine the extent to which these encounters impact CVD care practices and outcomes in this population. TRIAL REGISTRATION: ClinicalTrials.gov Identifier: NCT04025125.

Equity and bias in electronic health records data.

Embedded pragmatic clinical trials (ePCTs) are conducted during routine clinical care and have the potential to increase knowledge about the effectiveness of interventions under real world conditions. However, many pragmatic trials rely on data from the electronic health record (EHR) data, which are subject to bias from incomplete data, poor data quality, lack of representation from people who are medically underserved, and implicit bias in EHR design. This commentary examines how the use of EHR data might exacerbate bias and potentially increase health inequities. We offer recommendations for how to increase generalizability of ePCT results and begin to mitigate bias to promote health equity.

Mis-mappings between a producer's quantitative test codes and LOINC codes and an algorithm for correcting them.

OBJECTIVES: To access the accuracy of the Logical Observation Identifiers Names and Codes (LOINC) mapping to local laboratory test codes that is crucial to data integration across time and healthcare systems. MATERIALS AND METHODS: We used software tools and manual reviews to estimate the rate of LOINC mapping errors among 179 million mapped test results from 2 DataMarts in PCORnet. We separately reported unweighted and weighted mapping error rates, overall and by parts of the LOINC term. RESULTS: Of included 179 537 986 mapped results for 3029 quantitative tests, 95.4% were mapped correctly implying an 4.6% mapping error rate. Error rates were less than 5% for the more common tests with at least 100 000 mapped test results. Mapping errors varied across different LOINC classes. Error rates in chemistry and hematology classes, which together accounted for 92.0% of the mapped test results, were 0.4% and 7.5%, respectively. About 50% of mapping errors were due to errors in the property part of the LOINC name. DISCUSSIONS: Mapping errors could be detected automatically through inconsistencies in (1) qualifiers of the analyte, (2) specimen type, (3) property, and (4) method. Among quantitative test results, which are the large majority of reported tests, application of automatic error detection and correction algorithm could reduce the mapping errors further. CONCLUSIONS: Overall, the mapping error rate within the PCORnet data was 4.6%. This is nontrivial but less than other published error rates of 20%-40%. Such error rate decreased substantially to 0.1% after the application of automatic detection and correction algorithm.

Assessing the impact of privacy-preserving record linkage on record overlap and patient demographic and clinical characteristics in PCORnet®, the National Patient-Centered Clinical Research Network.

OBJECTIVE: This article describes the implementation of a privacy-preserving record linkage (PPRL) solution across PCORnet®, the National Patient-Centered Clinical Research Network. MATERIAL AND METHODS: Using a PPRL solution from Datavant, we quantified the degree of patient overlap across the network and report a de-duplicated analysis of the demographic and clinical characteristics of the PCORnet population. RESULTS: There were ∼170M patient records across the responding Network Partners, with ∼138M (81%) of those corresponding to a unique patient. 82.1% of patients were found in a single partner and 14.7% were in 2. The percentage overlap between Partners ranged between 0% and 80% with a median of 0%. Linking patients' electronic health records with claims increased disease prevalence in every clinical characteristic, ranging between 63% and 173%. DISCUSSION: The overlap between Partners was variable and depended on timeframe. However, patient data linkage changed the prevalence profile of the PCORnet patient population. CONCLUSIONS: This project was one of the largest linkage efforts of its kind and demonstrates the potential value of record linkage. Linkage between Partners may be most useful in cases where there is geographic proximity between Partners, an expectation that potential linkage Partners will be able to fill gaps in data, or a longer study timeframe.

Establishing a framework for privacy-preserving record linkage among electronic health record and administrative claims databases within PCORnet®, the National Patient-Centered Clinical Research Network.

OBJECTIVE: The aim of this study was to determine whether a secure, privacy-preserving record linkage (PPRL) methodology can be implemented in a scalable manner for use in a large national clinical research network. RESULTS: We established the governance and technical capacity to support the use of PPRL across the National Patient-Centered Clinical Research Network (PCORnet®). As a pilot, four sites used the Datavant software to transform patient personally identifiable information (PII) into de-identified tokens. We queried the sites for patients with a clinical encounter in 2018 or 2019 and matched their tokens to determine whether overlap existed. We described patient overlap among the sites and generated a "deduplicated" table of patient demographic characteristics. Overlapping patients were found in 3 of the 6 site-pairs. Following deduplication, the total patient count was 3,108,515 (0.11% reduction), with the largest reduction in count for patients with an "Other/Missing" value for Sex; from 198 to 163 (17.6% reduction). The PPRL solution successfully links patients across data sources using distributed queries without directly accessing patient PII. The overlap queries and analysis performed in this pilot is being replicated across the full network to provide additional insight into patient linkages among a distributed research network.

Standardizing, harmonizing, and protecting data collection to broaden the impact of COVID-19 research: the rapid acceleration of diagnostics-underserved populations (RADx-UP) initiative.

OBJECTIVE: The Rapid Acceleration of Diagnostics-Underserved Populations (RADx-UP) program is a consortium of community-engaged research projects with the goal of increasing access to Severe Acute Respiratory Syndrome Coronavirus 2 (SARS-CoV-2) tests in underserved populations. To accelerate clinical research, common data elements (CDEs) were selected and refined to standardize data collection and enhance cross-consortium analysis. MATERIALS AND METHODS: The RADx-UP consortium began with more than 700 CDEs from the National Institutes of Health (NIH) CDE Repository, Disaster Research Response (DR2) guidelines, and the PHENotypes and eXposures (PhenX) Toolkit. Following a review of initial CDEs, we made selections and further refinements through an iterative process that included live forums, consultations, and surveys completed by the first 69 RADx-UP projects. RESULTS: Following a multistep CDE development process, we decreased the number of CDEs, modified the question types, and changed the CDE wording. Most research projects were willing to collect and share demographic NIH Tier 1 CDEs, with the top exception reason being a lack of CDE applicability to the project. The NIH RADx-UP Tier 1 CDE with the lowest frequency of collection and sharing was sexual orientation. DISCUSSION: We engaged a wide range of projects and solicited bidirectional input to create CDEs. These RADx-UP CDEs could serve as the foundation for a patient-centered informatics architecture allowing the integration of disease-specific databases to support hypothesis-driven clinical research in underserved populations. CONCLUSION: A community-engaged approach using bidirectional feedback can lead to the better development and implementation of CDEs in underserved populations during public health emergencies.

Evaluating fitness-for-use of electronic health records in pragmatic clinical trials: reported practices and recommendations.

OBJECTIVE: To empirically explore how pragmatic clinical trials (PCTs) that used real-world data (RWD) assessed study-specific fitness-for-use. METHODS: We conducted interviews and surveys with PCT teams who used electronic health record (EHR) data to ascertain endpoints. The survey cataloged key concerns about RWD, activities used to assess data fitness-for-use, and related barriers encountered by study teams. Patterns and commonalities across trials were used to develop recommendations for study-specific fitness-for-use assessments. RESULTS: Of 15 invited trial teams, 7 interviews were conducted. Of 31 invited trials, 15 responded to the survey. Most respondents had prior experience using RWD (93%). Major concerns about EHR data were data reliability, missingness or incompleteness of EHR elements, variation in data quality across study sites, and presence of implausible or incorrect values. Although many PCTs conducted fitness-for-use activities (eg, data quality assessments, 11/14, 79%), less than a quarter did so before choosing a data source. Fitness-for-use activities, findings, and resulting study design changes were not often publically documented. Overall costs and personnel costs were barriers to fitness-for-use assessments. DISCUSSION: These results support three recommendations for PCTs that use EHR data for endpoint ascertainment. Trials should detail the rationale and plan for study-specific fitness-for-use activities, conduct study-specific fitness-for-use assessments early in the prestudy phase to inform study design changes before the trial begins, and share results of fitness-for-use assessments and description of relevant challenges and facilitators. CONCLUSION: These recommendations can help researchers and end-users of real-world evidence improve characterization of RWD reliability and relevance in the PCT-specific context.

Broadening the reach of the FDA Sentinel system: A roadmap for integrating electronic health record data in a causal analysis framework.

The Sentinel System is a major component of the United States Food and Drug Administration's (FDA) approach to active medical product safety surveillance. While Sentinel has historically relied on large quantities of health insurance claims data, leveraging longitudinal electronic health records (EHRs) that contain more detailed clinical information, as structured and unstructured features, may address some of the current gaps in capabilities. We identify key challenges when using EHR data to investigate medical product safety in a scalable and accelerated way, outline potential solutions, and describe the Sentinel Innovation Center's initiatives to put solutions into practice by expanding and strengthening the existing system with a query-ready, large-scale data infrastructure of linked EHR and claims data. We describe our initiatives in four strategic priority areas: (1) data infrastructure, (2) feature engineering, (3) causal inference, and (4) detection analytics, with the goal of incorporating emerging data science innovations to maximize the utility of EHR data for medical product safety surveillance.

Enhancing the use of EHR systems for pragmatic embedded research: lessons from the NIH Health Care Systems Research Collaboratory.

OBJECTIVE: We identified challenges and solutions to using electronic health record (EHR) systems for the design and conduct of pragmatic research. MATERIALS AND METHODS: Since 2012, the Health Care Systems Research Collaboratory has served as the resource coordinating center for 21 pragmatic clinical trial demonstration projects. The EHR Core working group invited these demonstration projects to complete a written semistructured survey and used an inductive approach to review responses and identify EHR-related challenges and suggested EHR enhancements. RESULTS: We received survey responses from 20 projects and identified 21 challenges that fell into 6 broad themes: (1) inadequate collection of patient-reported outcome data, (2) lack of structured data collection, (3) data standardization, (4) resources to support customization of EHRs, (5) difficulties aggregating data across sites, and (6) accessing EHR data. DISCUSSION: Based on these findings, we formulated 6 prerequisites for PCTs that would enable the conduct of pragmatic research: (1) integrate the collection of patient-centered data into EHR systems, (2) facilitate structured research data collection by leveraging standard EHR functions, usable interfaces, and standard workflows, (3) support the creation of high-quality research data by using standards, (4) ensure adequate IT staff to support embedded research, (5) create aggregate, multidata type resources for multisite trials, and (6) create re-usable and automated queries. CONCLUSION: We are hopeful our collection of specific EHR challenges and research needs will drive health system leaders, policymakers, and EHR designers to support these suggestions to improve our national capacity for generating real-world evidence.

Testing the Use of Data Drawn from the Electronic Health Record to Compare Quality.

INTRODUCTION: Health systems spend $1.5 billion annually reporting data on quality, but efficacy and utility for benchmarking are limited due, in part, to limitations of data sources. Our objective was to implement and evaluate measures of pediatric quality for three conditions using electronic health record (EHR)-derived data. METHODS: PCORnet networks standardized EHR-derived data to a common data model. In 13 health systems from 2 networks for 2015, we implemented the National Quality Forum measures: % children with sickle cell anemia who received a transcranial Doppler; % children on antipsychotics who had metabolic screening; and % pediatric acute otitis media with amoxicillin prescribed. Manual chart review assessed measure accuracy. RESULTS: Only 39% (N = 2,923) of 7,278 children on antipsychotics received metabolic screening (range: 20%-54%). If the measure indicated screening was performed, the chart agreed 88% of the time [95% confidence interval (CI): 81%-94%]; if it indicated screening was not done, the chart agreed 86% (95% CI: 78%-93%). Only 69% (N = 793) of 1,144 children received transcranial Doppler screening (range across sites: 49%-88%). If the measure indicated screening was performed, the chart agreed 98% of the time (95% CI: 94%-100%); if it indicated screening was not performed, the chart agreed 89% (95% CI: 82%-95%). For acute otitis media, chart review identified many qualifying cases missed by the National Quality Forum measure, which excluded a common diagnostic code. CONCLUSIONS: Measures of healthcare quality developed using EHR-derived data were valid and identified wide variation among network sites. This data can facilitate the identification and spread of best practices.

PCORnet® 2020: current state, accomplishments, and future directions.

OBJECTIVE: To describe PCORnet, a clinical research network developed for patient-centered outcomes research on a national scale. STUDY DESIGN AND SETTING: Descriptive study of the current state and future directions for PCORnet. We conducted cross-sectional analyses of the health systems and patient populations of the 9 Clinical Research Networks and 2 Health Plan Research Networks that are part of PCORnet. RESULTS: Within the Clinical Research Networks, electronic health data are currently collected from 337 hospitals, 169,695 physicians, 3,564 primary care practices, 338 emergency departments, and 1,024 community clinics. Patients can be recruited for prospective studies from any of these clinical sites. The Clinical Research Networks have accumulated data from 80 million patients with at least one visit from 2009 to 2018. The PCORnet Health Plan Research Network population of individuals with a valid enrollment segment from 2009 to 2019 exceeds 60 million individuals, who on average have 2.63 years of follow-up. CONCLUSION: PCORnet's infrastructure comprises clinical data from a diverse cohort of patients and has the capacity to rapidly access these patient populations for pragmatic clinical trials, epidemiological research, and patient-centered research on rare diseases.

Participant choices for return of genomic results in the eMERGE Network.

PURPOSE: Secondary findings are typically offered in an all or none fashion when sequencing is used for clinical purposes. This study aims to describe the process of offering categorical and granular choices for results in a large research consortium. METHODS: Within the third phase of the electronic MEdical Records and GEnomics (eMERGE) Network, several sites implemented studies that allowed participants to choose the type of results they wanted to receive from a multigene sequencing panel. Sites were surveyed to capture the details of the implementation protocols and results of these choices. RESULTS: Across the ten eMERGE sites, 4664 participants including adolescents and adults were offered some type of choice. Categories of choices offered and methods for selecting categories varied. Most participants (94.5%) chose to learn all genetic results, while 5.5% chose subsets of results. Several sites allowed participants to change their choices at various time points, and 0.5% of participants made changes. CONCLUSION: Offering choices that include learning some results is important and should be a dynamic process to allow for changes in scientific knowledge, participant age group, and individual preference.

Design and analytic considerations for using patient-reported health data in pragmatic clinical trials: report from an NIH Collaboratory roundtable.

Pragmatic clinical trials often entail the use of electronic health record (EHR) and claims data, but bias and quality issues associated with these data can limit their fitness for research purposes particularly for study end points. Patient-reported health (PRH) data can be used to confirm or supplement EHR and claims data in pragmatic trials, but these data can bring their own biases. Moreover, PRH data can complicate analyses if they are discordant with other sources. Using experience in the design and conduct of multi-site pragmatic trials, we itemize the strengths and limitations of PRH data and identify situational criteria for determining when PRH data are appropriate or ideal to fill gaps in the evidence collected from EHRs. To provide guidance for the scientific rationale and appropriate use of patient-reported data in pragmatic clinical trials, we describe approaches for ascertaining and classifying study end points and addressing issues of incomplete data, data alignment, and concordance. We conclude by identifying areas that require more research.

Considerations for using distributed research networks to conduct aspects of randomized trials.

Stakeholders in the clinical research enterprise are aligned around the need to make clinical research in general, and randomized controlled trials in particular, more meaningful and efficient. To that end, we have built distributed research networks (DRNs) for the Sentinel System, the National Institutes of Health (NIH) Collaboratory, and the National Patient-Centered Clinical Research Network (PCORnet). DRNs reuse electronic health record (EHR) and claims data for research. The design and use of health data DRNs is complicated by lack of uniformity in data collection, a fragmented healthcare system, and the imperative to protect research participants. We describe the key elements of successful DRNs, as well as methods, challenges, and solutions we have encountered in using DRNs to support different phases of randomized, multi-site, clinical research. This work supports "real-world" efforts to build a learning health system and will enable others to conduct randomized clinical trial research using a DRN.