Systematic data quality assessment of electronic health record data to evaluate study-specific fitness: Report from the PRESERVE research study.

Study-specific data quality testing is an essential part of minimizing analytic errors, particularly for studies making secondary use of clinical data. We applied a systematic and reproducible approach for study-specific data quality testing to the analysis plan for PRESERVE, a 15-site, EHR-based observational study of chronic kidney disease in children. This approach integrated widely adopted data quality concepts with healthcare-specific evaluation methods. We implemented two rounds of data quality assessment. The first produced high-level evaluation using aggregate results from a distributed query, focused on cohort identification and main analytic requirements. The second focused on extended testing of row-level data centralized for analysis. We systematized reporting and cataloguing of data quality issues, providing institutional teams with prioritized issues for resolution. We tracked improvements and documented anomalous data for consideration during analyses. The checks we developed identified 115 and 157 data quality issues in the two rounds, involving completeness, data model conformance, cross-variable concordance, consistency, and plausibility, extending traditional data quality approaches to address more complex stratification and temporal patterns. Resolution efforts focused on higher priority issues, given finite study resources. In many cases, institutional teams were able to correct data extraction errors or obtain additional data, avoiding exclusion of 2 institutions entirely and resolving 123 other gaps. Other results identified complexities in measures of kidney function, bearing on the study's outcome definition. Where limitations such as these are intrinsic to clinical data, the study team must account for them in conducting analyses. This study rigorously evaluated fitness of data for intended use. The framework is reusable and built on a strong theoretical underpinning. Significant data quality issues that would have otherwise delayed analyses or made data unusable were addressed. This study highlights the need for teams combining subject-matter and informatics expertise to address data quality when working with real world data.

Assessment of 135 794 Pediatric Patients Tested for Severe Acute Respiratory Syndrome Coronavirus 2 Across the United States.

Importance: There is limited information on severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) testing and infection among pediatric patients across the United States. Objective: To describe testing for SARS-CoV-2 and the epidemiology of infected patients. Design, Setting, and Participants: A retrospective cohort study was conducted using electronic health record data from 135 794 patients younger than 25 years who were tested for SARS-CoV-2 from January 1 through September 8, 2020. Data were from PEDSnet, a network of 7 US pediatric health systems, comprising 6.5 million patients primarily from 11 states. Data analysis was performed from September 8 to 24, 2020. Exposure: Testing for SARS-CoV-2. Main Outcomes and Measures: SARS-CoV-2 infection and coronavirus disease 2019 (COVID-19) illness. Results: A total of 135 794 pediatric patients (53% male; mean [SD] age, 8.8 [6.7] years; 3% Asian patients, 15% Black patients, 11% Hispanic patients, and 59% White patients; 290 per 10 000 population [range, 155-395 per 10 000 population across health systems]) were tested for SARS-CoV-2, and 5374 (4%) were infected with the virus (12 per 10 000 population [range, 7-16 per 10 000 population]). Compared with White patients, those of Black, Hispanic, and Asian race/ethnicity had lower rates of testing (Black: odds ratio [OR], 0.70 [95% CI, 0.68-0.72]; Hispanic: OR, 0.65 [95% CI, 0.63-0.67]; Asian: OR, 0.60 [95% CI, 0.57-0.63]); however, they were significantly more likely to have positive test results (Black: OR, 2.66 [95% CI, 2.43-2.90]; Hispanic: OR, 3.75 [95% CI, 3.39-4.15]; Asian: OR, 2.04 [95% CI, 1.69-2.48]). Older age (5-11 years: OR, 1.25 [95% CI, 1.13-1.38]; 12-17 years: OR, 1.92 [95% CI, 1.73-2.12]; 18-24 years: OR, 3.51 [95% CI, 3.11-3.97]), public payer (OR, 1.43 [95% CI, 1.31-1.57]), outpatient testing (OR, 2.13 [1.86-2.44]), and emergency department testing (OR, 3.16 [95% CI, 2.72-3.67]) were also associated with increased risk of infection. In univariate analyses, nonmalignant chronic disease was associated with lower likelihood of testing, and preexisting respiratory conditions were associated with lower risk of positive test results (standardized ratio [SR], 0.78 [95% CI, 0.73-0.84]). However, several other diagnosis groups were associated with a higher risk of positive test results: malignant disorders (SR, 1.54 [95% CI, 1.19-1.93]), cardiac disorders (SR, 1.18 [95% CI, 1.05-1.32]), endocrinologic disorders (SR, 1.52 [95% CI, 1.31-1.75]), gastrointestinal disorders (SR, 2.00 [95% CI, 1.04-1.38]), genetic disorders (SR, 1.19 [95% CI, 1.00-1.40]), hematologic disorders (SR, 1.26 [95% CI, 1.06-1.47]), musculoskeletal disorders (SR, 1.18 [95% CI, 1.07-1.30]), mental health disorders (SR, 1.20 [95% CI, 1.10-1.30]), and metabolic disorders (SR, 1.42 [95% CI, 1.24-1.61]). Among the 5374 patients with positive test results, 359 (7%) were hospitalized for respiratory, hypotensive, or COVID-19-specific illness. Of these, 99 (28%) required intensive care unit services, and 33 (9%) required mechanical ventilation. The case fatality rate was 0.2% (8 of 5374). The number of patients with a diagnosis of Kawasaki disease in early 2020 was 40% lower (259 vs 433 and 430) than in 2018 or 2019. Conclusions and Relevance: In this large cohort study of US pediatric patients, SARS-CoV-2 infection rates were low, and clinical manifestations were typically mild. Black, Hispanic, and Asian race/ethnicity; adolescence and young adulthood; and nonrespiratory chronic medical conditions were associated with identified infection. Kawasaki disease diagnosis is not an effective proxy for multisystem inflammatory syndrome of childhood.

Design and Refinement of a Data Quality Assessment Workflow for a Large Pediatric Research Network.

BACKGROUND: Clinical data research networks (CDRNs) aggregate electronic health record data from multiple hospitals to enable large-scale research. A critical operation toward building a CDRN is conducting continual evaluations to optimize data quality. The key challenges include determining the assessment coverage on big datasets, handling data variability over time, and facilitating communication with data teams. This study presents the evolution of a systematic workflow for data quality assessment in CDRNs. IMPLEMENTATION: Using a specific CDRN as use case, the workflow was iteratively developed and packaged into a toolkit. The resultant toolkit comprises 685 data quality checks to identify any data quality issues, procedures to reconciliate with a history of known issues, and a contemporary GitHub-based reporting mechanism for organized tracking. RESULTS: During the first two years of network development, the toolkit assisted in discovering over 800 data characteristics and resolving over 1400 programming errors. Longitudinal analysis indicated that the variability in time to resolution (15day mean, 24day IQR) is due to the underlying cause of the issue, perceived importance of the domain, and the complexity of assessment. CONCLUSIONS: In the absence of a formalized data quality framework, CDRNs continue to face challenges in data management and query fulfillment. The proposed data quality toolkit was empirically validated on a particular network, and is publicly available for other networks. While the toolkit is user-friendly and effective, the usage statistics indicated that the data quality process is very time-intensive and sufficient resources should be dedicated for investigating problems and optimizing data for research.

Empiric potassium supplementation and increased survival in users of loop diuretics.

BACKGROUND: The effectiveness of the clinical strategy of empiric potassium supplementation in reducing the frequency of adverse clinical outcomes in patients receiving loop diuretics is unknown. We sought to examine the association between empiric potassium supplementation and 1) all-cause death and 2) outpatient-originating sudden cardiac death (SD) and ventricular arrhythmia (VA) among new starters of loop diuretics, stratified on initial loop diuretic dose. METHODS: We conducted a one-to-one propensity score-matched cohort study using 1999-2007 US Medicaid claims from five states. Empiric potassium supplementation was defined as a potassium prescription on the day of or the day after the initial loop diuretic prescription. Death, the primary outcome, was ascertained from the Social Security Administration Death Master File; SD/VA, the secondary outcome, from incident, first-listed emergency department or principal inpatient SD/VA discharge diagnoses (positive predictive value = 85%). RESULTS: We identified 654,060 persons who met eligibility criteria and initiated therapy with a loop diuretic, 27% of whom received empiric potassium supplementation (N = 179,436) and 73% of whom did not (N = 474,624). The matched hazard ratio for empiric potassium supplementation was 0.93 (95% confidence interval, 0.89-0.98, p = 0.003) for all-cause death. Stratifying on initial furosemide dose, hazard ratios for empiric potassium supplementation with furosemide < 40 and ≥ 40 milligrams/day were 0.93 (0.86-1.00, p = 0.050) and 0.84 (0.79-0.89, p < 0.0001). The matched hazard ratio for empiric potassium supplementation was 1.02 (0.83-1.24, p = 0.879) for SD/VA. CONCLUSIONS: Empiric potassium supplementation upon initiation of a loop diuretic appears to be associated with improved survival, with a greater apparent benefit seen with higher diuretic dose. If confirmed, these findings support the use of empiric potassium supplementation upon initiation of a loop diuretic.