Systematic data quality assessment of electronic health record data to evaluate study-specific fitness: Report from the PRESERVE research study.

Study-specific data quality testing is an essential part of minimizing analytic errors, particularly for studies making secondary use of clinical data. We applied a systematic and reproducible approach for study-specific data quality testing to the analysis plan for PRESERVE, a 15-site, EHR-based observational study of chronic kidney disease in children. This approach integrated widely adopted data quality concepts with healthcare-specific evaluation methods. We implemented two rounds of data quality assessment. The first produced high-level evaluation using aggregate results from a distributed query, focused on cohort identification and main analytic requirements. The second focused on extended testing of row-level data centralized for analysis. We systematized reporting and cataloguing of data quality issues, providing institutional teams with prioritized issues for resolution. We tracked improvements and documented anomalous data for consideration during analyses. The checks we developed identified 115 and 157 data quality issues in the two rounds, involving completeness, data model conformance, cross-variable concordance, consistency, and plausibility, extending traditional data quality approaches to address more complex stratification and temporal patterns. Resolution efforts focused on higher priority issues, given finite study resources. In many cases, institutional teams were able to correct data extraction errors or obtain additional data, avoiding exclusion of 2 institutions entirely and resolving 123 other gaps. Other results identified complexities in measures of kidney function, bearing on the study's outcome definition. Where limitations such as these are intrinsic to clinical data, the study team must account for them in conducting analyses. This study rigorously evaluated fitness of data for intended use. The framework is reusable and built on a strong theoretical underpinning. Significant data quality issues that would have otherwise delayed analyses or made data unusable were addressed. This study highlights the need for teams combining subject-matter and informatics expertise to address data quality when working with real world data.

EHR-based Case Identification of Pediatric Long COVID: A Report from the RECOVER EHR Cohort.

Objective: Long COVID, marked by persistent, recurring, or new symptoms post-COVID-19 infection, impacts children's well-being yet lacks a unified clinical definition. This study evaluates the performance of an empirically derived Long COVID case identification algorithm, or computable phenotype, with manual chart review in a pediatric sample. This approach aims to facilitate large-scale research efforts to understand this condition better. Methods: The algorithm, composed of diagnostic codes empirically associated with Long COVID, was applied to a cohort of pediatric patients with SARS-CoV-2 infection in the RECOVER PCORnet EHR database. The algorithm classified 31,781 patients with conclusive, probable, or possible Long COVID and 307,686 patients without evidence of Long COVID. A chart review was performed on a subset of patients (n=651) to determine the overlap between the two methods. Instances of discordance were reviewed to understand the reasons for differences. Results: The sample comprised 651 pediatric patients (339 females, M age = 10.10 years) across 16 hospital systems. Results showed moderate overlap between phenotype and chart review Long COVID identification (accuracy = 0.62, PPV = 0.49, NPV = 0.75); however, there were also numerous cases of disagreement. No notable differences were found when the analyses were stratified by age at infection or era of infection. Further examination of the discordant cases revealed that the most common cause of disagreement was the clinician reviewers' tendency to attribute Long COVID-like symptoms to prior medical conditions. The performance of the phenotype improved when prior medical conditions were considered (accuracy = 0.71, PPV = 0.65, NPV = 0.74). Conclusions: Although there was moderate overlap between the two methods, the discrepancies between the two sources are likely attributed to the lack of consensus on a Long COVID clinical definition. It is essential to consider the strengths and limitations of each method when developing Long COVID classification algorithms.

Retrospective Multicenter Cohort Study on Safety and Electroencephalographic Response to Lacosamide for Neonatal Seizures.

BACKGROUND: There is growing evidence supporting the safety and effectiveness of lacosamide in older children. However, minimal data are available for neonates. We aimed to determine the incidence of adverse events associated with lacosamide use and explore the electroencephalographic seizure response to lacosamide in neonates. METHODS: A retrospective cohort study was conducted using data from seven pediatric hospitals from January 2009 to February 2020. For safety outcomes, neonates were followed for ≤30 days from index date. Electroencephalographic response of lacosamide was evaluated based on electroencephalographic reports for ≤3 days. RESULTS: Among 47 neonates, 98% received the first lacosamide dose in the intensive care units. During the median follow-up of 12 days, 19% of neonates died, and the crude incidence rate per 1000 patient-days (95% confidence interval) of the adverse events by diagnostic categories ranged from 2.8 (0.3, 10.2) for blood or lymphatic system disorders and nervous system disorders to 10.5 (4.2, 21.6) for cardiac disorders. Electroencephalographic seizures were observed in 31 of 34 patients with available electroencephalographic data on the index date. There was seizure improvement in 29% of neonates on day 1 and also in 29% of neonates on day 2. On day 3, there was no change in 50% of neonates and unknown change in 50% of neonates. CONCLUSIONS: The results are reassuring regarding the safety of lacosamide in neonates. Although some neonates had fewer seizures after lacosamide administration, the lack of a comparator arm and reliance on qualitative statements in electroencephalographic reports limit the preliminary efficacy results.

Distinguishing characteristics of pediatric patients with primary hyperoxaluria type 1 in PEDSnet.

BACKGROUND: Primary hyperoxaluria type 1 (PH1) is an autosomal recessive inborn error of metabolism that causes oxalate deposition, leading to recurrent calcium oxalate kidney stones, chronic kidney disease and systemic oxalosis, which produces a broad range of serious life-threatening complications. Patients with PH1 have delayed diagnosis due to the rarity of the disease and the overlap with early-onset kidney stone disease not due to primary hyperoxaluria. OBJECTIVE: The objective of this study was to determine the clinical features of individuals <21 years of age with PH1 that precede its diagnosis. We hypothesized that a parsimonious set of features could be identified that differentiate patients with PH1 from patients with non-primary hyperoxaluria-associated causes of early-onset kidney stone disease. STUDY DESIGN: We determined the association between clinical characteristics and PH1 diagnosis in a case-control study conducted between 2009 and 2021 in PEDSnet, a clinical research network of eight US pediatric health systems. Each patient with genetically confirmed PH1 was matched by sex and PEDSnet institution to up to 4 control patients with kidney stones without PH of any type. We obtained patient characteristics and diagnostic test results occurring before to less than 6 months after study entrance from a centralized database query and from manual chart review. Differences were examined using standardized differences and multivariable regression. RESULTS: The study sample included 37 patients with PH1 and 147 controls. Patients with PH1 were younger at diagnosis (median age of 3 vs 13.5 years); 75 % of children with PH1 were less than 8 years-old. Patients with PH1 were more likely to have combinations of nephrocalcinosis on ultrasound or CT (43 % vs 3 %), lower eGFR at diagnosis (median = 52 mL/min/1.73 m2 vs 114 mL/min/1.73 m2), and have normal mobility. Patients with PH1 had higher proportion of calcium oxalate monohydrate kidney stones than controls (median = 100 % vs 10 %). There were no differences in diagnosis of failure to thrive, stone size, or echocardiography results. CONCLUSIONS: Children with PH1 are characterized by presentation before adolescence, nephrocalcinosis, decreased eGFR at diagnosis, and calcium oxalate monohydrate stone composition. If externally validated, these characteristics could facilitate earlier diagnosis and treatment of children with PH1.

Derivation of paediatric blood pressure percentiles from electronic health records.

BACKGROUND: Identification of abnormal blood pressure (BP) in children requires normative data. We sought to examine the feasibility of using "real-world" office BP data obtained from electronic health records (EHR) to generate age-, sex- and height-specific BP percentiles for children. METHODS: Using data collected 01/01/2009-8/31/2021 from eight large children's healthcare organisations in PEDSnet, we applied a mixed-effects polynomial regression model with random slopes to generate Z-scores and BP percentiles and compared them with currently used normative BP distributions published in the 2017 American Academy of Paediatrics (AAP) Clinical Practise Guidelines (CPG). FINDINGS: We identified a study sample of 292,412 children (1,085,083 BP measurements), ages 3-17 years (53% female), with no chronic medical conditions, who were not overweight/obese and who were primarily seen for general paediatric care in outpatient settings. Approximately 45,000-75,000 children contributed data to each age category. The PEDSnet systolic BP percentile values were 1-4 mmHg higher than AAP CPG BP values across age-sex-height groups, with larger differences observed in younger children. Diastolic BP values were also higher in younger children; starting with age 7 years, diastolic BP percentile values were 1-3 mmHg lower than AAP CPG values. Cohen's Kappa was 0.90 for systolic BP, 0.66 for diastolic BP, and 0.80 overall indicating excellent agreement between PEDSnet and 2017 AAP CPG data for systolic BP and substantial agreement for diastolic BP. INTERPRETATION: Our analysis indicates that real-word EHR data can be used to generate BP percentiles consistent with current clinical practise on BP management in children. FUNDING: Funding for this work was provided by the Preserving Kidney Function in Children with Chronic Kidney Disease (PRESERVE) study; Patient-Centred Outcomes Research Institute (PCORI) RD-2020C2020338 (Principal Investigator: Dr. Forrest; Co-Principal Investigator: Dr. Denburg).

The real world experience of pediatric primary hyperoxaluria patients in the PEDSnet clinical research network.

The rarity of primary hyperoxaluria (PH) challenges our understanding of the disease. The purpose of our study was to describe the course of clinical care in a United States cohort of PH pediatric patients, highlighting health service utilization. We performed a retrospective cohort study of PH patients < 18 years old in the PEDSnet clinical research network from 2009 to 2021. Outcomes queried included diagnostic imaging and testing related to known organ involvement of PH, surgical and medical interventions specific to PH-related renal disease, and select PH-related hospital service utilization. Outcomes were evaluated relative to cohort entrance date (CED), defined as date of first PH-related diagnostic code. Thirty-three patients were identified: 23 with PH type 1; 4 with PH type 2; 6 with PH type 3. Median age at CED was 5.0 years (IQR 1.4, 9.3 years) with the majority being non-Hispanic white (73%) males (70%). Median follow-up between CED and most recent encounter was 5.1 years (IQR 1.2, 6.8). Nephrology and Urology were the most common specialties involved in care, with low utilization of other sub-specialties (12%-36%). Most patients (82%) had diagnostic imaging used to evaluate kidney stones; 11 (33%) had studies of extra-renal involvement. Stone surgery was performed in 15 (46%) patients. Four patients (12%) required dialysis, begun in all prior to CED; four patients required renal or renal/liver transplant.    Conclusion: In this large cohort of U.S. PH children, patients required heavy health care utilization with room for improvement in involving multi-disciplinary specialists. What is Known: • Primary hyperoxaluria (PH) is rare with significant implications on patient health. Typical involvement includes the kidneys; however, extra-renal manifestations occur. • Most large population studies describe clinical manifestations and involve registries. What is New: • We report the clinical journey, particularly related to diagnostic studies, interventions, multispecialty involvement, and hospital utilization, of a large cohort of PH pediatric patients in the PEDSnet clinical research network. • There are missed opportunities, particularly in that of specialty care, that could help in the diagnosis, treatment, and even prevention of known clinical manifestations.

Clinical course and management of children with IgA vasculitis with nephritis.

BACKGROUND: IgA vasculitis is the most common vasculitis in children and is often complicated by acute nephritis (IgAVN). Risk of chronic kidney disease (CKD) among children with IgAVN remains unknown. This study aimed to describe the clinical management and kidney outcomes in a large cohort of children with IgAVN. METHODS: This observational cohort study used the PEDSnet database to identify children diagnosed with IgAV between January 1, 2009, and February 29, 2020. Demographic and clinical characteristics were compared among children with and without kidney involvement. For children followed by nephrology, clinical course, and management patterns were described. Patients were divided into four categories based on treatment: observation, renin-angiotensin-aldosterone system (RAAS) blockade, corticosteroids, and other immunosuppression, and outcomes were compared among these groups. RESULTS: A total of 6802 children had a diagnosis of IgAV, of whom 1139 (16.7%) were followed by nephrology for at least 2 visits over a median follow-up period of 1.7 years [0.4,4.2]. Conservative management was the most predominant practice pattern, consisting of observation in 57% and RAAS blockade in 6%. Steroid monotherapy was used in 29% and other immunosuppression regimens in 8%. Children receiving immunosuppression had higher rates of proteinuria and hypertension compared to those managed with observation (p < 0.001). At the end of follow-up, 2.6 and 0.5% developed CKD and kidney failure, respectively. CONCLUSIONS: Kidney outcomes over a limited follow-up period were favorable in a large cohort of children with IgAV. Immunosuppressive medications were used in those with more severe presentations and may have contributed to improved outcomes. A higher resolution version of the Graphical abstract is available as Supplementary information.

Safety of intravenous lacosamide in hospitalized children and neonates.

OBJECTIVE: Seizures are common in critically ill children and neonates, and these patients would benefit from intravenous (IV) antiseizure medications with few adverse effects. We aimed to assess the safety profile of IV lacosamide (LCM) among children and neonates. METHODS: This retrospective multicenter cohort study examined the safety of IV LCM use in 686 children and 28 neonates who received care between January 2009 and February 2020. RESULTS: Adverse events (AEs) were attributed to LCM in only 1.5% (10 of 686) of children, including rash (n = 3, .4%), somnolence (n = 2, .3%), and bradycardia, prolonged QT interval, pancreatitis, vomiting, and nystagmus (n = 1, .1% each). There were no AEs attributed to LCM in the neonates. Across all 714 pediatric patients, treatment-emergent AEs occurring in >1% of patients included rash, bradycardia, somnolence, tachycardia, vomiting, feeling agitated, cardiac arrest, tachyarrhythmia, low blood pressure, hypertension, decreased appetite, diarrhea, delirium, and gait disturbance. There were no reports of PR interval prolongation or severe cutaneous adverse reactions. When comparing children who received a recommended versus a higher than recommended initial dose of IV LCM, there was a twofold increase in the risk of rash in the higher dose cohort (adjusted incidence rate ratio = 2.11, 95% confidence interval = 1.02-4.38). SIGNIFICANCE: This large observational study provides novel evidence demonstrating the tolerability of IV LCM in children and neonates.

Clinical Features and Burden of Postacute Sequelae of SARS-CoV-2 Infection in Children and Adolescents.

Importance: The postacute sequelae of SARS-CoV-2 infection (PASC) has emerged as a long-term complication in adults, but current understanding of the clinical presentation of PASC in children is limited. Objective: To identify diagnosed symptoms, diagnosed health conditions, and medications associated with PASC in children. Design, Setting and Participants: This retrospective cohort study used electronic health records from 9 US children's hospitals for individuals younger than 21 years who underwent antigen or reverse transcriptase-polymerase chain reaction (RT-PCR) testing for SARS-CoV-2 between March 1, 2020, and October 31, 2021, and had at least 1 encounter in the 3 years before testing. Exposures: SARS-CoV-2 positivity by viral test (antigen or RT-PCR). Main Outcomes and Measures: Syndromic (symptoms), systemic (conditions), and medication PASC features were identified in the 28 to 179 days following the initial test date. Adjusted hazard ratios (aHRs) were obtained for 151 clinically predicted PASC features by contrasting viral test-positive groups with viral test-negative groups using proportional hazards models, adjusting for site, age, sex, testing location, race and ethnicity, and time period of cohort entrance. The incidence proportion for any syndromic, systemic, or medication PASC feature was estimated in the 2 groups to obtain a burden of PASC estimate. Results: Among 659 286 children in the study sample, 348 091 (52.8%) were male, and the mean (SD) age was 8.1 (5.7) years. A total of 59 893 (9.1%) tested positive by viral test for SARS-CoV-2, and 599 393 (90.9%) tested negative. Most were tested in outpatient testing facility settings (322 813 [50.3%]) or office settings (162 138 [24.6%]). The most common syndromic, systemic, and medication features were loss of taste or smell (aHR, 1.96; 95% CI, 1.16-3.32), myocarditis (aHR, 3.10; 95% CI, 1.94-4.96), and cough and cold preparations (aHR, 1.52; 95% CI, 1.18-1.96), respectively. The incidence of at least 1 systemic, syndromic, or medication feature of PASC was 41.9% (95% CI, 41.4-42.4) among viral test-positive children vs 38.2% (95% CI, 38.1-38.4) among viral test-negative children, with an incidence proportion difference of 3.7% (95% CI, 3.2-4.2). A higher strength of association for PASC was identified in those cared for in the intensive care unit during the acute illness phase, children younger than 5 years, and individuals with complex chronic conditions. Conclusions and Relevance: In this large-scale, exploratory study, the burden of pediatric PASC that presented to health systems was low. Myocarditis was the most commonly diagnosed PASC-associated condition. Acute illness severity, young age, and comorbid complex chronic disease increased the risk of PASC.

Diagnostic Code-Based Screening for Identifying Children with Primary Hyperoxaluria.

PURPOSE: We evaluated the utility of diagnostic codes to screen for patients with primary hyperoxaluria (PH) and evaluate their positive predictive value (PPV) in identifying children with this rare condition in PEDSnet, a clinical research network of pediatric health systems that shares electronic health records data. MATERIALS AND METHODS: We conducted a cross-sectional study of children who received care at 7 PEDSnet institutions from January 2009 through January 2021. We developed and applied screening criteria using diagnostic codes that generated 3 categories of the hypothesized probability of PH. Tier 1 had specific diagnostic codes for PH; tier 2 had codes for hyperoxaluria, oxalate nephropathy, or oxalosis; and tier 3 had a combination of ≥2 codes for disorder of carbohydrate metabolism and ≥1 code for kidney stones. We reviewed the electronic health records of patients with possible PH to confirm PH diagnosis and evaluate the accuracy and timing of diagnostic codes. The PPV of the codes was compared across tiers, time, PH type, and site. RESULTS: We identified 341 patients in the screen; 33 had confirmed PH (9.7%). Tier 1 had the highest proportion of PH; however, the PPV was only 20%. The degree to which an institution accurately represented point of care diagnoses in the data extraction process was predictive of higher PPV. The PPV of diagnostic codes was highest for PH3 (100%) and lowest for PH1 (22.8%). CONCLUSIONS: Diagnostic codes for PH have poor PPV. Findings suggest that one should be careful in research using large databases in which source validation is not possible.

Clinical features and burden of post-acute sequelae of SARS-CoV-2 infection in children and adolescents: an exploratory EHR-based cohort study from the RECOVER program.

Importance: The post-acute sequelae of SARS-CoV-2 (PASC) has emerged as a long-term complication in adults, but current understanding of the clinical presentation of PASC in children is limited. Objective: To identify diagnosed symptoms, diagnosed health conditions and medications associated with PASC in children. Design Setting and Participants: Retrospective cohort study using electronic health records from 9 US children's hospitals for individuals <21 years-old who underwent reverse transcriptase polymerase chain reaction (RT-PCR) testing for SARS-CoV-2 between March 1, 2020 - October 31, 2021 and had at least 1 encounter in the 3 years before testing. Exposure: SARS-CoV-2 PCR positivity. Main Outcomes and Measures: We identified syndromic (symptoms), systemic (conditions), and medication PASC features in the 28-179 days following the initial test date. Adjusted hazard ratios (aHRs) were obtained for 151 clinically predicted PASC features by contrasting PCR-positive with PCR-negative groups using proportional hazards models, adjusting for site, age, sex, testing location, race/ethnicity, and time-period of cohort entrance. We estimated the incidence proportion for any syndromic, systemic or medication PASC feature in the two groups to obtain a burden of PASC estimate. Results: Among 659,286 children in the study sample, 59,893 (9.1%) tested positive by PCR for SARS-CoV-2. Most were tested in outpatient testing facility (50.3%) or office (24.6%) settings. The most common syndromic, systemic, and medication features were loss of taste or smell (aHR 1.96 [95% CI 1.16-3.32), myocarditis (aHR 3.10 [95% CI 1.94-4.96]), and cough and cold preparations (aHR 1.52 [95% CI 1.18-1.96]). The incidence of at least one systemic/syndromic/medication feature of PASC was 41.9% among PCR-positive children versus 38.2% among PCR-negative children, with an incidence proportion difference of 3.7% (95% CI 3.2-4.2%). A higher strength of association for PASC was identified in those cared for in the ICU during the acute illness phase, children less than 5 years-old, and individuals with complex chronic conditions. Conclusions and Relevance: In this large-scale, exploratory study, the burden of pediatric PASC that presented to health systems was low. Myocarditis was the most commonly diagnosed PASC-associated condition. Acute illness severity, young age, and comorbid complex chronic disease increased the risk of PASC. Key Points: Question: What are the incidence and clinical features of post-acute sequelae of SARS-CoV-2 infection (PASC) in children?Findings: In this retrospective cohort study of 659,286 children tested for SARS-CoV-2 by polymerase chain reaction (PCR), the symptom, condition and medication with the strongest associations with SARS-CoV-2 infection were loss of taste/smell, myocarditis, and cough and cold preparations. The incidence proportion of non-MIS-C related PASC in the PCR-positive group exceeded the PCR-negative group by 3.7% (95% CI 3.2-4.2), with increased rates associated with acute illness severity, young age, and medical complexity.Meaning: PASC in children appears to be uncommon, with features that differ from adults.

Testing an Automated Approach to Identify Variation in Outcomes among Children with Type 1 Diabetes across Multiple Sites.

Introduction: Efficient methods to obtain and benchmark national data are needed to improve comparative quality assessment for children with type 1 diabetes (T1D). PCORnet is a network of clinical data research networks whose infrastructure includes standardization to a Common Data Model (CDM) incorporating electronic health record (EHR)-derived data across multiple clinical institutions. The study aimed to determine the feasibility of the automated use of EHR data to assess comparative quality for T1D. Methods: In two PCORnet networks, PEDSnet and OneFlorida, the study assessed measures of glycemic control, diabetic ketoacidosis admissions, and clinic visits in 2016-2018 among youth 0-20 years of age. The study team developed measure EHR-based specifications, identified institution-specific rates using data stored in the CDM, and assessed agreement with manual chart review. Results: Among 9,740 youth with T1D across 12 institutions, one quarter (26%) had two or more measures of A1c greater than 9% annually (min 5%, max 47%). The median A1c was 8.5% (min site 7.9, max site 10.2). Overall, 4% were hospitalized for diabetic ketoacidosis (min 2%, max 8%). The predictive value of the PCORnet CDM was >75% for all measures and >90% for three measures. Conclusions: Using EHR-derived data to assess comparative quality for T1D is a valid, efficient, and reliable data collection tool for measuring T1D care and outcomes. Wide variations across institutions were observed, and even the best-performing institutions often failed to achieve the American Diabetes Association HbA1C goals (<7.5%).