Assessing the interchangeability of linked scores in multivariable statistical analyses.

PURPOSE: Using the lens of classical test theory, we examine a linkage's generalizability with respect to use in multivariable analyses, including multiple regression and structural equation modeling, rather than comparison of established subpopulations as is most common in the literature. METHODS: To aid in this evaluation, we present a structural-equation-modeling based statistical method to examine the suitability of a given linkage for use cases involving continuous and categorical variables external to the linkage itself. RESULTS: Using the PROMIS® Parent Proxy and Early Childhood Global Health measures, we show that, although a high correlation between the scores (here, r = .829) may imply a general suitability for linking, a more detailed investigation of content, measurement structure, and results of the proposed methodology reveal important differences between the measures which can compromise interchangeability in certain use cases. CONCLUSION: In addition to the statistical quality of a linkage, users of linking methodology should also assess the question of whether the linkage is appropriate to apply to particular use cases of interest.

Development of the PROMIS pediatric stigma and extension to the PROMIS pediatric stigma: skin item banks.

PURPOSE: To develop the PROMIS Pediatric Stigma (PPS) and Skin (PPS-Skin) by constructing a common metric for measuring stigma in children with various conditions, while capturing the unique features of each condition. METHODS: Data from 860 children, ages 8-17, with a diagnosis of epilepsy, pNF (neurofibromatosis type 1 associated neurofibroma plexform), MD (muscular dystrophy), cancer, or skin conditions recruited from three projects were analyzed. Children with epilepsy, pNF and MD (sample-1) completed the original 18-item Neuro-QoL Stigma, while children with cancer and skin conditions (e.g., atopic dermatitis, psoriasis, and genetic skin disorders; sample-2) completed a 16-item version and 6 additional skin related items. Exploratory factor analysis (EFA) and confirmatory analysis (CFA) were used to evaluate unidimensionality of 24 stigma items. Differential item functioning (DIF) was used to evaluate measurement equivalence on group, gender, age, and conditions. Item response theory model (IRT) was used to construct the final measure. RESULTS: Sufficient unidimensionality was supported by both EFA and CFA. No items showed significant DIF indicating stable measurement properties across groups of comparison. All items fit the IRT model and were able to be calibrated together to form the PPS which consists of 18 core items. The PPS-Skin (18 cores items + 6 skin items) was developed by calibrating 6 skin items onto the common metric as the PPS. CONCLUSIONS: We used IRT techniques to successfully develop the PPS and the PPS-Skin, which share a common metric and account for unique and common concerns related to chronic conditions.

Prediction of internalizing and externalizing symptoms in late childhood from attention-deficit/hyperactivity disorder symptoms in early childhood.

Limited analyses based on national samples have assessed whether early attention-deficit/hyperactivity disorder (ADHD) symptoms predict later internalizing and externalizing symptoms in youth and the influence of sex and pubertal timing on subsequent psychiatric symptoms. This study analyzed data (n = 2818) from the Environmental influences on Child Health Outcomes Program national cohort. Analyses used data from early childhood (mean age = 5.3 years) utilizing parent-reported ADHD symptoms to predict rates of internalizing and externalizing symptoms from late childhood/adolescence (mean age = 11.9 years). Within a subsample age at peak height velocity (APHV) acted as a proxy to assess pubertal timing from early childhood (mean age = 5.4 years) to adolescence (mean age = 12.3 years). Early-childhood ADHD symptoms predicted later psychiatric symptoms, including anxiety, depression, aggressive behavior, conduct problems, oppositional defiant disorder, and rule-breaking behavior. Earlier APHV was associated with increased Conduct Disorder symptoms from late childhood to adolescence for females only. A stronger relation between ADHD symptoms and later aggression was observed in females with earlier APHV, whereas this same pattern with aggression, conduct problems and depression was observed in males with later APHV. Clinicians should consider that both young girls and boys with elevated ADHD symptoms, particularly with off-set pubertal timing, may be at risk for later psychiatric symptoms.

Measurement bias in caregiver-report of early childhood behavior problems across demographic factors in an ECHO-wide diverse sample.

Background: Research and clinical practice rely heavily on caregiver-report measures, such as the Child Behavior Checklist 1.5-5 (CBCL/1.5-5), to gather information about early childhood behavior problems and to screen for child psychopathology. While studies have shown that demographic variables influence caregiver ratings of behavior problems, the extent to which the CBCL/1.5-5 functions equivalently at the item level across diverse samples is unknown. Methods: Item-level data of CBCL/1.5-5 from a large sample of young children (N = 9087) were drawn from 26 cohorts in the Environmental influences on Child Health Outcomes program. Factor analyses and the alignment method were applied to examine measurement invariance (MI) and differential item functioning (DIF) across child (age, sex, bilingual status, and neurodevelopmental disorders), and caregiver (sex, education level, household income level, depression, and language version administered) characteristics. Child race was examined in sensitivity analyses. Results: Items with the most impactful DIF across child and caregiver groupings were identified for Internalizing, Externalizing, and Total Problems. The robust item sets, excluding the high DIF items, showed good reliability and high correlation with the original Internalizing and Total Problems scales, with lower reliability for Externalizing. Language version of CBCL administration, education level and sex of the caregiver respondent showed the most significant impact on MI, followed by child age. Sensitivity analyses revealed that child race has a unique impact on DIF over and above socioeconomic status. Conclusions: The CBCL/1.5-5, a caregiver-report measure of early childhood behavior problems, showed bias across demographic groups. Robust item sets with less DIF can measure Internalizing and Total Problems equally as well as the full item sets, with slightly lower reliability for Externalizing, and can be crosswalked to the metric of the full item set, enabling calculation of normed T scores based on more robust item sets.