Sensitivity of the NIH Toolbox to Detect Cognitive Change in Individuals With Intellectual and Developmental Disability.

BACKGROUND AND OBJECTIVE: Individuals with intellectual disability (ID) experience protracted cognitive development compared with typical youth. Sensitive measurement of cognitive change in this population is a critical need for clinical trials and other intervention studies, but well-validated outcome measures are scarce. This study's aim was to evaluate the sensitivity of the NIH Toolbox Cognition Battery (NIHTB-CB) to detect developmental changes in groups with ID-fragile X syndrome (FXS), Down syndrome (DS), and other ID (OID)-and to provide further support for its use as an outcome measure for treatment trials. METHODS: We administered the NIHTB-CB and a reference standard cross-validation measure (Stanford-Binet Intelligence Scales, Fifth Edition [SB5]) to 256 individuals with FXS, DS, and OID (ages 6-27 years). After 2 years of development, we retested 197 individuals. Group developmental changes in each cognitive domain of the NIHTB-CB and SB5 were assessed using latent change score models, and 2-year growth was evaluated at 3 age points (10, 16, and 22 years). RESULTS: Overall, effect sizes of growth measured by the NIHTB-CB tests were comparable with or exceeded those of the SB5. The NIHTB-CB showed significant gains in almost all domains in OID at younger ages (10 years), with continued gains at 16 years and stability in early adulthood (22 years). The FXS group showed delayed gains in attention and inhibitory control compared with OID. The DS group had delayed gains in receptive vocabulary compared with OID. Unlike the other groups, DS had significant growth in early adulthood in 2 domains (working memory and attention/inhibitory control). Notably, each group's pattern of NIHTB-CB growth across development corresponded to their respective pattern of SB5 growth. DISCUSSION: The NIHTB-CB is sensitive to developmental changes in individuals with ID. Comparison with levels and timing of growth on the cross-validation measure shows that the NIHTB-CB has potential to identify meaningful trajectories across cognitive domains and ID etiologies. Sensitivity to change within the context of treatment studies and delineation of clinically meaningful changes in NIHTB-CB scores, linked to daily functioning, must be established in future research to evaluate the battery more completely as a key outcome measure.

Validation of the NIH Toolbox Cognitive Battery in intellectual disability.

OBJECTIVE: To advance the science of cognitive outcome measurement for individuals with intellectual disability (ID), we established administration guidelines and evaluated the psychometric properties of the NIH-Toolbox Cognitive Battery (NIHTB-CB) for use in clinical research. METHODS: We assessed feasibility, test-retest reliability, and convergent validity of the NIHTB-CB (measuring executive function, processing speed, memory, and language) by assessing 242 individuals with fragile X syndrome (FXS), Down syndrome (DS), and other ID, ages 6 through 25 years, with retesting completed after 1 month. To facilitate accessibility and measurement accuracy, we developed accommodations and standard assessment guidelines, documented in an e-manual. Finally, we assessed the sensitivity of the battery to expected syndrome-specific cognitive phenotypes. RESULTS: Above a mental age of 5.0 years, all tests had excellent feasibility. More varied feasibility across tests was seen between mental ages of 3 and 4 years. Reliability and convergent validity ranged from moderate to strong. Each test and the Crystallized and Fluid Composite scores correlated moderately to strongly with IQ, and the Crystallized Composite had modest correlations with adaptive behavior. The NIHTB-CB showed known-groups validity by detecting expected executive function deficits in FXS and a receptive language deficit in DS. CONCLUSION: The NIHTB-CB is a reliable and valid test battery for children and young adults with ID with a mental age of ≈5 years and above. Adaptations for very low-functioning or younger children with ID are needed for some subtests to expand the developmental range of the battery. Studies examining sensitivity to developmental and treatment changes are now warranted.

The NIH Toolbox Cognitive Battery for intellectual disabilities: three preliminary studies and future directions.

BACKGROUND: Recent advances in understanding molecular and synaptic mechanisms of intellectual disabilities (ID) in fragile X syndrome (FXS) and Down syndrome (DS) through animal models have led to targeted controlled trials with pharmacological agents designed to normalize these underlying mechanisms and improve clinical outcomes. However, several human clinical trials have failed to demonstrate efficacy of these targeted treatments to improve surrogate behavioral endpoints. Because the ultimate index of disease modification in these disorders is amelioration of ID, the validation of cognitive measures for tracking treatment response is essential. Here, we present preliminary research to validate the National Institutes of Health Toolbox Cognitive Battery (NIH-TCB) for ID. METHODS: We completed three pilot studies of patients with FXS (total n = 63; mean age 19.3 ± 8.3 years, mean mental age 5.3 ± 1.6 years), DS (n = 47; mean age 16.1 ± 6.2, mean mental age 5.4 ± 2.0), and idiopathic ID (IID; n = 16; mean age 16.1 ± 5.0, mean mental age 6.6 ± 2.3) measuring processing speed, executive function, episodic memory, word/letter reading, receptive vocabulary, and working memory using the web-based NIH-TB-CB, addressing feasibility, test-retest reliability, construct validity, ecological validity, and syndrome differences and profiles. RESULTS: Feasibility was good to excellent (≥80 % of participants with valid scores) for above mental age 4 years for all tests except list sorting (working memory). Test-retest stability was good to excellent, and convergent validity was similar to or better than results obtained from typically developing children in the normal sample for executive function and language measures. Examination of ecological validity revealed moderate to very strong correlations between the NIH-TCB composite and adaptive behavior and full-scale IQ measures. Syndrome/group comparisons demonstrated significant deficits for the FXS and DS groups relative to IID on attention and inhibitory control, a significant reading weakness for FXS, and a receptive vocabulary weakness for DS. CONCLUSIONS: The NIH-TCB has potential for assessing important dimensions of cognition in persons with ID, and several tests may be useful for tracking response to intervention. However, more extensive psychometric studies, evaluation of the NIH-TCB's sensitivity to change, both developmentally and in the context of treatment, and perhaps establishing links to brain function in these populations, are required to determine the true utility of the battery as a set of outcome measures.

Improving IQ measurement in intellectual disabilities using true deviation from population norms.

BACKGROUND: Intellectual disability (ID) is characterized by global cognitive deficits, yet the very IQ tests used to assess ID have limited range and precision in this population, especially for more impaired individuals. METHODS: We describe the development and validation of a method of raw z-score transformation (based on general population norms) that ameliorates floor effects and improves the precision of IQ measurement in ID using the Stanford Binet 5 (SB5) in fragile X syndrome (FXS; n = 106), the leading inherited cause of ID, and in individuals with idiopathic autism spectrum disorder (ASD; n = 205). We compared the distributional characteristics and Q-Q plots from the standardized scores with the deviation z-scores. Additionally, we examined the relationship between both scoring methods and multiple criterion measures. RESULTS: We found evidence that substantial and meaningful variation in cognitive ability on standardized IQ tests among individuals with ID is lost when converting raw scores to standardized scaled, index and IQ scores. Use of the deviation z- score method rectifies this problem, and accounts for significant additional variance in criterion validation measures, above and beyond the usual IQ scores. Additionally, individual and group-level cognitive strengths and weaknesses are recovered using deviation scores. CONCLUSION: Traditional methods for generating IQ scores in lower functioning individuals with ID are inaccurate and inadequate, leading to erroneously flat profiles. However assessment of cognitive abilities is substantially improved by measuring true deviation in performance from standardization sample norms. This work has important implications for standardized test development, clinical assessment, and research for which IQ is an important measure of interest in individuals with neurodevelopmental disorders and other forms of cognitive impairment.

Psychometric study of the Aberrant Behavior Checklist in Fragile X Syndrome and implications for targeted treatment.

Animal studies elucidating the neurobiology of fragile X syndrome (FXS) have led to multiple controlled trials in humans, with the Aberrant Behavior Checklist-Community (ABC-C) commonly adopted as a primary outcome measure. A multi-site collaboration examined the psychometric properties of the ABC-C in 630 individuals (ages 3-25) with FXS using exploratory and confirmatory factor analysis. Results support a six-factor structure, with one factor unchanged (Inappropriate Speech), four modified (Irritability, Hyperactivity, Lethargy/Withdrawal, and Stereotypy), and a new Social Avoidance factor. A comparison with ABC-C data from individuals with general intellectual disability and a list of commonly endorsed items are also reported. Reformulated ABC-C scores based on this FXS-specific factor structure may provide added outcome measure specificity and sensitivity in FXS clinical trials.