Systematic data quality assessment of electronic health record data to evaluate study-specific fitness: Report from the PRESERVE research study.

Study-specific data quality testing is an essential part of minimizing analytic errors, particularly for studies making secondary use of clinical data. We applied a systematic and reproducible approach for study-specific data quality testing to the analysis plan for PRESERVE, a 15-site, EHR-based observational study of chronic kidney disease in children. This approach integrated widely adopted data quality concepts with healthcare-specific evaluation methods. We implemented two rounds of data quality assessment. The first produced high-level evaluation using aggregate results from a distributed query, focused on cohort identification and main analytic requirements. The second focused on extended testing of row-level data centralized for analysis. We systematized reporting and cataloguing of data quality issues, providing institutional teams with prioritized issues for resolution. We tracked improvements and documented anomalous data for consideration during analyses. The checks we developed identified 115 and 157 data quality issues in the two rounds, involving completeness, data model conformance, cross-variable concordance, consistency, and plausibility, extending traditional data quality approaches to address more complex stratification and temporal patterns. Resolution efforts focused on higher priority issues, given finite study resources. In many cases, institutional teams were able to correct data extraction errors or obtain additional data, avoiding exclusion of 2 institutions entirely and resolving 123 other gaps. Other results identified complexities in measures of kidney function, bearing on the study's outcome definition. Where limitations such as these are intrinsic to clinical data, the study team must account for them in conducting analyses. This study rigorously evaluated fitness of data for intended use. The framework is reusable and built on a strong theoretical underpinning. Significant data quality issues that would have otherwise delayed analyses or made data unusable were addressed. This study highlights the need for teams combining subject-matter and informatics expertise to address data quality when working with real world data.

The Preserving Kidney Function in Children With CKD (PRESERVE) Study: Rationale, Design, and Methods.

Rationale & Objective: PRESERVE seeks to provide new knowledge to inform shared decision-making regarding blood pressure (BP) management for pediatric chronic kidney disease (CKD). PRESERVE will compare the effectiveness of alternative strategies for monitoring and treating hypertension on preserving kidney function; expand the National Patient-Centered Clinical Research Network (PCORnet) common data model by adding pediatric- and kidney-specific variables and linking electronic health record data to other kidney disease databases; and assess the lived experiences of patients related to BP management. Study Design: Multicenter retrospective cohort study (clinical outcomes) and cross-sectional study (patient-reported outcomes [PROs]). Setting & Participants: PRESERVE will include approximately 20,000 children between January 2009-December 2022 with mild-moderate CKD from 15 health care institutions that participate in 6 PCORnet Clinical Research Networks (PEDSnet, STAR, GPC, PaTH, CAPRiCORN, and OneFlorida+). The inclusion criteria were ≥1 nephrologist visit and ≥2 estimated glomerular filtration rate (eGFR) values in the range of 30 to <90 mL/min/1.73 m2 separated by ≥90 days without an intervening value ≥90 mL/min/1.73 m2 and no prior dialysis or kidney transplant. Exposures: BP measurements (clinic-based and 24-hour ambulatory BP); urine protein; and antihypertensive treatment by therapeutic class. Outcomes: The primary outcome is a composite event of a 50% reduction in eGFR, eGFR of <15 mL/min/1.73 m2, long-term dialysis or kidney transplant. Secondary outcomes include change in eGFR, adverse events, and PROs. Analytical Approach: Longitudinal models for dichotomous (proportional hazards or accelerated failure time) and continuous (generalized linear mixed models) clinical outcomes; multivariable linear regression for PROs. We will evaluate heterogeneity of treatment effect by CKD etiology and degree of proteinuria and will examine variation in hypertension management and outcomes based on socio-demographics. Limitations: Causal inference limited by observational analyses. Conclusions: PRESERVE will leverage the PCORnet infrastructure to conduct large-scale observational studies that address BP management knowledge gaps for pediatric CKD, focusing on outcomes that are meaningful to patients. Plain-Language Summary: Hypertension is a major modifiable contributor to loss of kidney function in chronic kidney disease (CKD). The purpose of PRESERVE is to provide evidence to inform shared decision-making regarding blood pressure management for children with CKD. PRESERVE is a consortium of 16 health care institutions in PCORnet, the National Patient-Centered Clinical Research Network, and includes electronic health record data for >19,000 children with CKD. PRESERVE will (1) expand the PCORnet infrastructure for research in pediatric CKD by adding kidney-specific variables and linking electronic health record data to other kidney disease databases; (2) compare the effectiveness of alternative strategies for monitoring and treating hypertension on preserving kidney function; and (3) assess the lived experiences of patients and caregivers related to blood pressure management.

Skeletal Outcomes in Children and Young Adults with Glomerular Disease.

BACKGROUND: Children with glomerular disease have unique risk factors for compromised bone health. Studies addressing skeletal complications in this population are lacking. METHODS: This retrospective cohort study utilized data from PEDSnet, a national network of pediatric health systems with standardized electronic health record data for more than 6.5 million patients from 2009 to 2021. Incidence rates (per 10,000 person-years) of fracture, slipped capital femoral epiphysis (SCFE), and avascular necrosis/osteonecrosis (AVN) in 4598 children and young adults with glomerular disease were compared with those among 553,624 general pediatric patients using Poisson regression analysis. The glomerular disease cohort was identified using a published computable phenotype. Inclusion criteria for the general pediatric cohort were two or more primary care visits 1 year or more apart between 1 and 21 years of age, one visit or more every 18 months if followed >3 years, and no chronic progressive conditions defined by the Pediatric Medical Complexity Algorithm. Fracture, SCFE, and AVN were identified using SNOMED-CT diagnosis codes; fracture required an associated x-ray or splinting/casting procedure within 48 hours. RESULTS: We found a higher risk of fracture for the glomerular disease cohort compared with the general pediatric cohort in girls only (incidence rate ratio [IRR], 1.6; 95% CI, 1.3 to 1.9). Hip/femur and vertebral fracture risk were increased in the glomerular disease cohort: adjusted IRR was 2.2 (95% CI, 1.3 to 3.7) and 5 (95% CI, 3.2 to 7.6), respectively. For SCFE, the adjusted IRR was 3.4 (95% CI, 1.9 to 5.9). For AVN, the adjusted IRR was 56.2 (95% CI, 40.7 to 77.5). CONCLUSIONS: Children and young adults with glomerular disease have significantly higher burden of skeletal complications than the general pediatric population.

Measuring BMI change among children and adolescents.

BACKGROUND: Weight control programs for children monitor BMI changes using BMI z-scores that adjust BMI for the sex and age of the child. It is, however, uncertain if BMIz is the best metric for assessing BMI change. OBJECTIVE: To identify which of 6 BMI metrics is optimal for assessing change. We considered a metric to be optimal if its short-term variability was consistent across the entire BMI distribution. SUBJECTS: 285 643 2- to 17-year-olds with BMI measured 3 times over a 10- to 14-month period. METHODS: We summarized each metric's variability using the within-child standard deviation. RESULTS: Most metrics' initial or mean value correlated with short-term variability (|r| ~ 0.3 to 0.5). The metric for which the within-child variability was largely independent (r = 0.13) of the metric's initial or mean value was the percentage of the 50th expressed on a log scale. However, changes in this metric between the first and last visits were highly (r ≥ 0.97) correlated with changes in %95th and %50th. CONCLUSIONS: Log %50 was the metric for which the short-term variability was largely independent of a child's BMI. Changes in log %50th, %95th, and %50th are strongly correlated.

Using a Multi-Institutional Pediatric Learning Health System to Identify Systemic Lupus Erythematosus and Lupus Nephritis: Development and Validation of Computable Phenotypes.

BACKGROUND AND OBJECTIVES: Performing adequately powered clinical trials in pediatric diseases, such as SLE, is challenging. Improved recruitment strategies are needed for identifying patients. DESIGN, SETTING, PARTICIPANTS, & MEASUREMENTS: Electronic health record algorithms were developed and tested to identify children with SLE both with and without lupus nephritis. We used single-center electronic health record data to develop computable phenotypes composed of diagnosis, medication, procedure, and utilization codes. These were evaluated iteratively against a manually assembled database of patients with SLE. The highest-performing phenotypes were then evaluated across institutions in PEDSnet, a national health care systems network of >6.7 million children. Reviewers blinded to case status used standardized forms to review random samples of cases (n=350) and noncases (n=350). RESULTS: Final algorithms consisted of both utilization and diagnostic criteria. For both, utilization criteria included two or more in-person visits with nephrology or rheumatology and ≥60 days follow-up. SLE diagnostic criteria included absence of neonatal lupus, one or more hydroxychloroquine exposures, and either three or more qualifying diagnosis codes separated by ≥30 days or one or more diagnosis codes and one or more kidney biopsy procedure codes. Sensitivity was 100% (95% confidence interval [95% CI], 99 to 100), specificity was 92% (95% CI, 88 to 94), positive predictive value was 91% (95% CI, 87 to 94), and negative predictive value was 100% (95% CI, 99 to 100). Lupus nephritis diagnostic criteria included either three or more qualifying lupus nephritis diagnosis codes (or SLE codes on the same day as glomerular/kidney codes) separated by ≥30 days or one or more SLE diagnosis codes and one or more kidney biopsy procedure codes. Sensitivity was 90% (95% CI, 85 to 94), specificity was 93% (95% CI, 89 to 97), positive predictive value was 94% (95% CI, 89 to 97), and negative predictive value was 90% (95% CI, 84 to 94). Algorithms identified 1508 children with SLE at PEDSnet institutions (537 with lupus nephritis), 809 of whom were seen in the past 12 months. CONCLUSIONS: Electronic health record-based algorithms for SLE and lupus nephritis demonstrated excellent classification accuracy across PEDSnet institutions.

Interrelationships among age at adiposity rebound, BMI during childhood, and BMI after age 14 years in an electronic health record database.

OBJECTIVE: This study compared the importance of age at adiposity rebound versus childhood BMI to subsequent BMI levels in a longitudinal analysis. METHODS: From the electronic health records of 4.35 million children, a total of 12,228 children were selected who were examined at least once each year between ages 2 and 7 years and reexamined after age 14 years. The minimum number of examinations per child was six. Each child's rebound age was estimated using locally weighted regression (lowess), a smoothing technique. RESULTS: Children who had a rebound age < 3 years were, on average, 7 kg/m2 heavier after age 14 years than were children with a rebound age ≥ 7 years. However, BMI after age 14 years was more strongly associated with BMI at the rebound than with rebound age (r = 0.57 vs. -0.44). Furthermore, a child's BMI at age 3 years provided more information on BMI after age 14 years than did rebound age. In addition, rebound age provided no information on subsequent BMI if a child's BMI at age 6 years was known. CONCLUSIONS: Although rebound age is related to BMI after age 14 years, a child's BMI at age 3 years provides more information and is easier to obtain.

Differences between morphological and repetition priming in auditory lexical decision: Implications for decompositional models.

A natural way of probing the effects of morphology on lexical processing is to directly compare morphological priming, for which primes and targets share a stem but are mismatched in morphological structure (e.g., frogs â†’ frog), with outright repetition priming (e.g., frog â†’ frog). However, work making this comparison has reported no difference between these two types of priming. Importantly, the reported non-differences have been found in the visual domain. Here, we investigate morphological (Morph) versus repetition (Rep) priming in two auditory primed lexical decision experiments. Using the English plural suffix -/z/, we compare Rep priming with Morph priming for both singular and plural target conditions (e.g., frog/frogs â†’ frog, frog/frogs â†’ frogs). Overall, we find robust priming in both Rep and Morph conditions. However, for both singular and plural targets, there is consistent evidence that Rep priming is greater than Morph priming at early lags of 0 and 1 intervening items. This facilitation decreases with an increasing number of intervening items. Comparisons with phonological and semantic controls demonstrate that this pattern cannot be attributed solely to shared form or meaning. We interpret these findings in a decompositional model of morphological processing. The robust facilitation in Morph and Rep conditions is attributed to the activation of a shared stem representation. The convergence of Morph and Rep is attributed to a diminishing episodic trace related to morphological recombination.

Auditory morphological processing: Evidence from phonological priming.

Using an auditory lexical decision task, we find evidence of a facilitatory priming effect for morphologically complex targets (e.g., snow-ed) preceded by primes which rhyme with the target's stem (e.g., dough). By using rhyme priming, we are able to probe for morphological processing in a way that avoids confounds arising from semantic relatedness that are inherent to morphological priming (snow/snow-ed). Phonological control conditions (e.g., targets code and grove for prime dough) are used to rule out alternative interpretations of the effect that are based on partial rhyme or phonological embedding of the stem. The findings provide novel evidence for an independent morphological component in lexical processing and demonstrate the utility of rhyme priming in probing morphological representation.