Construction of a computerized adaptive test (CAT-CCNB) for efficient neurocognitive and clinical psychopathology assessment.

BACKGROUND: Traditional paper-and-pencil neurocognitive evaluations and semi-structured mental health interviews can take hours to administer and score. Computerized assessment has decreased that burden substantially, and contemporary psychometric tools such as item response theory and computerized adaptive testing (CAT) allow even further abbreviation. NEW METHOD: The goal of this paper was to describe the application of CAT and related methods to the Penn Computerized Neurocognitive Battery (CNB) and a well-validated clinical assessment in order to increase efficiency in assessment and relevant domain coverage. To calibrate item banks for CAT, N = 5053 participants (63% female; mean age 45 years, range 18-80) were collected from across the United States via crowdsourcing, providing item parameters that were then linked to larger item banks and used in individual test construction. Tests not amenable to CAT were abbreviated using complementary short-form methods. RESULTS: The final "CAT-CCNB" battery comprised 21 cognitive tests (compared to 14 in the original) and five adaptive clinical scales (compared to 16 in the original). COMPARISON WITH EXISTING METHODS: This new battery, derived with contemporary psychometric approaches, provides further improvements over existing assessments that use collections of fixed-length tests developed for stand-alone administration. The CAT-CCNB provides an improved version of the CNB that shows promise as a maximally efficient tool for neuropsychiatric assessment. CONCLUSIONS: We anticipate CAT-CCNB will help satisfy the clear need for broad yet efficient measurement of cognitive and clinical domains, facilitating implementation of large-scale, "big science" approaches to data collection, and potential widespread clinical implementation.

Development and public release of the Penn Reading Assessment Computerized Adaptive Test (PRA-CAT) for premorbid IQ.

An important component of neuropsychological testing is assessment of premorbid intelligence to estimate a patient's ability independent of neurological impairment. A common test of premorbid IQ-namely, the Reading section of the Wide Range Achievement Test (WRAT)-has been shown to have high measurement error in the high ability range, is unnecessarily long (55 items), and is proprietary. We describe the development of an alternative, nonproprietary, computerized adaptive test for premorbid IQ, the Penn Reading Assessment (PRA-CAT). PRA-CAT items were calibrated using a 1-parameter item response theory model in a large community sample (N = 9,498), Ages 8 to 21, and the resulting parameters were used to simulate computerized adaptive testing sessions. Simulations demonstrated that the PRA-CAT achieves low measurement error (0.25; equivalent to Cronbach's alpha = .94) and acceptable measurement error (0.40; Cronbach's alpha = .84) after only 18 and 6 items, respectively (on average). Correlation of WRAT and PRA-CAT scores with numerous clinical, cognitive, demographic, and neuroimaging criteria suggests that validity of PRA-CAT score interpretation is comparable (and sometimes superior) with the WRAT. The fully functioning PRA-CAT for public use (including item parameter estimates reported here) has been built using the open-source program Concerto, and can be installed by anyone on a local computer or on the "cloud." Given the length and proprietary nature of the WRAT, the PRA-CAT shows promise as a potential alternative (and with minimal or no cost). Further validation in the context of neurological injury is needed. (PsycINFO Database Record (c) 2019 APA, all rights reserved).

Validation of the Cognition Test Battery for Spaceflight in a Sample of Highly Educated Adults.

BACKGROUND: Neuropsychological changes that may occur due to the environmental and psychological stressors of prolonged spaceflight motivated the development of the Cognition Test Battery. The battery was designed to assess multiple domains of neurocognitive functions linked to specific brain systems. Tests included in Cognition have been validated, but not in high-performing samples comparable to astronauts, which is an essential step toward ensuring their usefulness in long-duration space missions. METHODS: We administered Cognition (on laptop and iPad) and the WinSCAT, counterbalanced for order and version, in a sample of 96 subjects (50% women; ages 25-56 yr) with at least a Master's degree in science, technology, engineering, or mathematics (STEM). We assessed the associations of age, sex, and administration device with neurocognitive performance, and compared the scores on the Cognition battery with those of WinSCAT. Confirmatory factor analysis compared the structure of the iPad and laptop administration methods using Wald tests. RESULTS: Age was associated with longer response times (mean ß = 0.12) and less accurate (mean ß = -0.12) performance, women had longer response times on psychomotor (ß = 0.62), emotion recognition (ß = 0.30), and visuo-spatial (ß = 0.48) tasks, men outperformed women on matrix reasoning (ß = -0.34), and performance on an iPad was generally faster (mean ß = -0.55). The WinSCAT appeared heavily loaded with tasks requiring executive control, whereas Cognition assessed a larger variety of neurocognitive domains. DISCUSSION: Overall results supported the interpretation of Cognition scores as measuring their intended constructs in high performing astronaut analog samples.Moore TM, Basner M, Nasrini J, Hermosillo E, Kabadi S, Roalf DR, McGuire S, Ecker AJ, Ruparel K, Port AM, Jackson CT, Dinges DF, Gur RC. Validation of the Cognition Test Battery for spaceflight in a sample of highly educated adults. Aerosp Med Hum Perform. 2017; 88(10):937-946.

Design and methods of the NiCK study: neurocognitive assessment and magnetic resonance imaging analysis of children and young adults with chronic kidney disease.

BACKGROUND: Chronic kidney disease is strongly linked to neurocognitive deficits in adults and children, but the pathophysiologic processes leading to these deficits remain poorly understood. The NiCK study (Neurocognitive Assessment and Magnetic Resonance Imaging Analysis of Children and Young Adults with Chronic Kidney Disease) seeks to address critical gaps in our understanding of the biological basis for neurologic abnormalities in chronic kidney disease. In this report, we describe the objectives, design, and methods of the NiCK study. DESIGN/METHODS: The NiCK Study is a cross-sectional cohort study in which neurocognitive and neuroimaging phenotyping is performed in children and young adults, aged 8 to 25 years, with chronic kidney disease compared to healthy controls. Assessments include (1) comprehensive neurocognitive testing (using traditional and computerized methods); (2) detailed clinical phenotyping; and (3) multimodal magnetic resonance imaging (MRI) to assess brain structure (using T1-weighted MRI, T2-weighted MRI, and diffusion tensor imaging), functional connectivity (using functional MRI), and blood flow (using arterial spin labeled MRI). Primary analyses will examine group differences in neurocognitive testing and neuroimaging between subjects with chronic kidney disease and healthy controls. Mechanisms responsible for neurocognitive dysfunction resulting from kidney disease will be explored by examining associations between neurocognitive testing and regional changes in brain structure, functional connectivity, or blood flow. In addition, the neurologic impact of kidney disease comorbidities such as anemia and hypertension will be explored. We highlight aspects of our analytical approach that illustrate the challenges and opportunities posed by data of this scope. DISCUSSION: The NiCK study provides a unique opportunity to address key questions about the biological basis of neurocognitive deficits in chronic kidney disease. Understanding these mechanisms could have great public health impact by guiding screening strategies, delivery of health information, and targeted treatment strategies for chronic kidney disease and its related comorbidities.