Generating an item pool for translational social cognition research: methodology and initial validation.

Existing sets of social and emotional stimuli suitable for social cognition research are limited in many ways, including size, unimodal stimulus delivery, and restriction to major universal emotions. Existing measures of social cognition could be improved by taking advantage of item response theory and adaptive testing technology to develop instruments that obtain more efficient measures of multimodal social cognition. However, for this to be possible, large pools of emotional stimuli must be obtained and validated. We present the development of a large, high-quality multimedia stimulus set produced by professional adult and child actors (ages 5 to 74) containing both visual and vocal emotional expressions. We obtained over 74,000 audiovisual recordings of a wide array of emotional and social behaviors, including the main universal emotions (happiness, sadness, anger, fear, disgust, and surprise), as well as more complex social expressions (pride, affection, sarcasm, jealousy, and shame). The actors generated a high quantity of technically superior, ecologically valid stimuli that were digitized, archived, and rated for accuracy and intensity of expressions. A subset of these facial and vocal expressions of emotion and social behavior were submitted for quantitative ratings to generate parameters for validity and discriminability. These stimuli are suitable for affective neuroscience-based psychometric tests, functional neuroimaging, and social cognitive rehabilitation programs. The purposes of this report are to describe the method of obtaining and validating this database and to make it accessible to the scientific community. We invite all those interested in participating in the use and validation of these stimuli to access them at www.med.upenn.edu/bbl/actors/index.shtml .

Development, Administration, and Structural Validity of a Brief, Computerized Neurocognitive Battery: Results From the Army Study to Assess Risk and Resilience in Servicemembers.

The Army Study to Assess Risk and Resilience in Servicemembers (Army STARRS) is a research project aimed at identifying risk and protective factors for suicide and related mental health outcomes among Army Soldiers. The New Soldier Study component of Army STARRS included the assessment of a range of cognitive- and emotion-processing domains linked to brain systems related to suicidal behavior including posttraumatic stress disorder, mood disorders, substance use disorders, and impulsivity. We describe the design and application of the Army STARRS neurocognitive test battery to a sample of 56,824 soldiers. We investigate its structural and concurrent validity through factor analysis and correlation of scores with demographics. We conclude that, in addition to being composed of previously well-validated measures, the Army STARRS neurocognitive battery as a whole demonstrates good psychometric properties. Correlations of scores with age and sex differences mostly replicate previously published findings, highlighting moderate to large effect sizes even within this restricted age range. Factor structures of scores conform to theoretical expectations. This neurocognitive battery provides a brief, valid measurement of neurocognition that may be helpful in predicting mental health and military performance. These measures can be integrated with neuroimaging to offer a powerful tool for assessing neurocognition in Servicemembers.

The Psychosis Spectrum in 22q11.2 Deletion Syndrome Is Comparable to That of Nondeleted Youths.

BACKGROUND: Chromosome 22q11.2 deletion syndrome (22q11DS) is a promising model for studying psychosis risk. Direct comparisons of psychosis features between 22q11DS and nondeleted (ND) individuals are limited by inconsistency and small samples. In the largest study to date, we compare 22q11DS to ND in comorbidities, functioning, cognition, and psychosis features across the full range of overall severity. METHODS: ND youths (n = 150) ages 9 to 24 years were matched to 22q11DS individuals (n = 150) on age and sex, stratifying for presence of psychosis spectrum disorder. Individuals were evaluated for psychosis using the Structured Interview for Prodromal Syndromes, and for attention-deficit/hyperactivity, substance-related, and mood disorders. Differential item functioning analysis addressed whether 22q11DS differs from ND in the probability of clinically significant ratings while holding constant the overall level of psychosis. RESULTS: Onset of psychosis proneness was similar among 22q11DS (mean: 11.0 years) and ND (mean: 12.1 years) individuals. Accounting for higher overall psychosis symptoms, 22q11DS participants were still more likely to manifest impaired stress tolerance, avolition, and ideational richness; ND individuals were more likely to exhibit unusual thoughts, persecutory ideas, and bizarre thinking. Cognition was impaired in 22q11DS, but it did not correlate with symptoms except ideational richness. Comorbid anxiety disorders were more likely in psychosis spectrum 22q11DS; substance-related disorders were more likely in ND. Global assessment of function was similar in 22q11DS and ND individuals, except among those with low total Structured Interview for Prodromal Syndromes scores. CONCLUSIONS: Individuals with 22q11DS share overarching similarities with ND individuals in psychosis symptoms and age of onset for psychosis proneness; this continues to support the 22q11DS model as a valuable window into mechanisms contributing to psychosis.

Development of an itemwise efficiency scoring method: Concurrent, convergent, discriminant, and neuroimaging-based predictive validity assessed in a large community sample.

Traditional "paper-and-pencil" testing is imprecise in measuring speed and hence limited in assessing performance efficiency, but computerized testing permits precision in measuring itemwise response time. We present a method of scoring performance efficiency (combining information from accuracy and speed) at the item level. Using a community sample of 9,498 youths age 8-21, we calculated item-level efficiency scores on 4 neurocognitive tests, and compared the concurrent, convergent, discriminant, and predictive validity of these scores with simple averaging of standardized speed and accuracy-summed scores. Concurrent validity was measured by the scores' abilities to distinguish men from women and their correlations with age; convergent and discriminant validity were measured by correlations with other scores inside and outside of their neurocognitive domains; predictive validity was measured by correlations with brain volume in regions associated with the specific neurocognitive abilities. Results provide support for the ability of itemwise efficiency scoring to detect signals as strong as those detected by standard efficiency scoring methods. We find no evidence of superior validity of the itemwise scores over traditional scores, but point out several advantages of the former. The itemwise efficiency scoring method shows promise as an alternative to standard efficiency scoring methods, with overall moderate support from tests of 4 different types of validity. This method allows the use of existing item analysis methods and provides the convenient ability to adjust the overall emphasis of accuracy versus speed in the efficiency score, thus adjusting the scoring to the real-world demands the test is aiming to fulfill. (PsycINFO Database Record

Development of an abbreviated form of the Penn Line Orientation Test using large samples and computerized adaptive test simulation.

Visuospatial processing is a commonly assessed neurocognitive domain with deficits linked to dysfunction in right posterior regions of the brain. With the growth of large-scale clinical research studies, there is an increased need for efficient and scalable assessments of neurocognition, including visuospatial processing. The purpose of the current study was to use a novel method that combines item response theory (IRT) and computerized adaptive testing (CAT) approaches to create an abbreviated form of the computerized Penn Line Orientation Test (PLOT). The 24-item PLOT was administered to 8,498 youths (aged 8-21 years) as part of the Philadelphia Neurodevelopmental Cohort study and, by Web-based data collection, in an independent sample of 4,593 adults from Great Britain as part of a TV documentary. IRT-based CAT simulations were used to select the best PLOT items for an abbreviated form by performing separate simulations in each group and choosing only items that were selected as useful (i.e., high item discrimination and in the appropriate difficulty range) in at least 1 of the simulations. Fifteen items were chosen for the final, short form of the PLOT, indicating substantial agreement among the models in how they evaluated each item's usefulness. Moreover, this abbreviated version performed comparably to the full version in tests of sensitivity to age and sex effects. This abbreviated version of the PLOT cuts administration time by 50% without detectable loss of information, which points to its feasibility for large-scale clinical and genomic studies.

Development and Validation of the Cognition Test Battery for Spaceflight.

BACKGROUND: Sustained high-level cognitive performance is of paramount importance for the success of space missions, which involve environmental, physiological, and psychological stressors that may affect brain functions. Despite subjective symptom reports of cognitive fluctuations in spaceflight, the nature of neurobehavioral functioning in space has not been clarified. METHODS: We developed a computerized cognitive test battery (Cognition) that has sensitivity to multiple cognitive domains and was specifically designed for the high-performing astronaut population. Cognition consists of 15 unique forms of 10 neuropsychological tests that cover a range of cognitive domains, including emotion processing, spatial orientation, and risk decision making. Cognition is based on tests known to engage specific brain regions as evidenced by functional neuroimaging. Here we describe the first normative and acute total sleep deprivation data on the Cognition test battery as well as several efforts underway to establish the validity, sensitivity, feasibility, and acceptability of Cognition. RESULTS: Practice effects and test-retest variability differed substantially between the 10 Cognition tests, illustrating the importance of normative data that both reflect practice effects and differences in stimulus set difficulty in the population of interest. After one night without sleep, medium to large effect sizes were observed for 3 of the 10 tests addressing vigilant attention (Cohen's d = 1.00), cognitive throughput (d = 0.68), and abstract reasoning (d = 0.65). CONCLUSIONS: In addition to providing neuroimaging-based novel information on the effects of spaceflight on a range of cognitive functions, Cognition will facilitate comparing the effects of ground-based analogues to spaceflight, increase consistency across projects, and thus enable meta-analyses.

Impact of psychiatric comorbidity and cognitive deficit on function in 22q11.2 deletion syndrome.

OBJECTIVE: Presence of psychiatric comorbidity is associated with poor functioning and is an important consideration in treatment. Many individuals with 22q11.2 deletion syndrome (22q11DS) develop comorbid psychiatric disorders, yet its pattern and impact on functioning have not been formally investigated. In this cross-sectional study, we examined the relationship between comorbid psychopathology and neurocognitive deficits and their association with global functioning. We hypothesized that higher psychiatric burden and psychosis-spectrum features would be associated with reduced functioning and increased neurocognitive deficits. METHOD: The cohort included 171 individuals with 22q11DS and mean (SD) age of 17.4 (8.1) years, recruited from a tertiary children's hospital and nationally through social media between September 2010 and December 2013. Psychiatric diagnoses and functioning were assessed using semistructured interviews and the Global Assessment of Functioning (GAF) scale, respectively. On the basis of psychopathology and number of comorbid diagnoses, participants were assigned to unaffected (n = 32), nonpsychosis spectrum (n = 24), nonpsychosis spectrum-plus (n = 15), psychosis spectrum (n = 29), and psychosis spectrum-plus (n = 71) groups. Executive function, episodic memory, complex cognition, social cognition, and praxis speed were assessed using a computerized neurocognitive battery (CNB). Cognitive profile and GAF scores were compared among the groups, and the association of GAF with cognitive performance and psychopathology was examined. RESULTS: We observed high rates of comorbid psychiatric disorders. Approximately 50% of the participants had ≥ 2 diagnoses. Psychosis spectrum disorders were most frequently comorbid with other disorders. GAF score was progressively worse with increased psychiatric burden. Mean (SD) GAF score for the unaffected group (81.1 [8.9]) was significantly different from those of nonpsychosis spectrum (68.6 [12.1]), nonpsychosis spectrum-plus (63.4 [8.8]), psychosis spectrum (58.7 [13.1]), or psychosis spectrum-plus (55.5 [13.3]) (P < .05) groups. All groups performed poorly and were comparable to each other on the CNB (P = .273). Notably, verbal memory (P = .003), spatial processing (P = .001), and parent education level (P < .001) were significantly associated with GAF. CONCLUSIONS: Individuals with 22q11DS have high rates of comorbid psychiatric disorders and diffuse cognitive deficits regardless of psychiatric burden. Those with psychotic spectrum disorders and comorbid psychiatric disorders are at an increased risk for poor overall functioning.

Feasibility of cognitive functional assessment in cardiac arrest survivors using an abbreviated laptop-based neurocognitive battery.

Cardiac arrest survivors exhibit varying degrees of neurological recovery even in the setting of targeted temperature management (TTM) use, ranging from severe impairments to making a seemingly full return to neurologic baseline function. We sought to explore the feasibility of utilizing a laptop-based neurocognitive battery to identify more subtle cognitive deficits in this population. In a convenience sample of cardiac arrest survivors discharged with a cerebral performance category (CPC) of 1, we evaluated the use of a computerized neurocognitive battery (CNB) in this group compared to a healthy control normative population. The CNB was designed to test 11 specific neurocognitive domains, including such areas as working memory and spatial processing. Testing was scored for both accuracy and speed. In a feasibility convenience sample of 29 cardiac arrest survivors, the mean age was 52.9±16.7 years; 12 patients received postarrest TTM and 17 did not receive TTM. Patients tolerated the battery well and performed at normative levels for both accuracy and speed on most of the 11 domains, but showed reduced accuracy of working memory and speed of spatial memory with large magnitudes (>1 SD), even among those receiving TTM. Across all domains, including those using speed and accuracy, 7 of the 29 subjects (24%) achieved statistically significant scores lower from the normative population in two or more domains. In this population of CPC 1 cardiac arrest survivors, a sensitive neurocognitive battery was feasible and suggests that specific cognitive deficits can be detected compared to a normative population, despite CPC 1 designation. Such testing might allow improved measurement of outcomes following TTM interventions in future trials.

Neurocognitive growth charting in psychosis spectrum youths.

IMPORTANCE: Psychosis-risk studies have examined help-seeking adolescents and young adults. Population-based studies evaluating psychotic symptoms and neurocognitive performance across childhood are needed for "growth charting" cognitive development. We hypothesized that psychosis spectrum youths have delayed neurocognitive age relative to chronological age. We expected larger lags with increased symptom severity and in late adolescence and early adulthood. OBJECTIVES: To examine neurocognitive age and compare typically developing participants with psychosis spectrum participants. DESIGN, SETTING, AND PARTICIPANTS: The Philadelphia Neurodevelopmental Cohort is a genotyped sample, with electronic medical records, enrolled in the study of brain behavior. In an academic and children's hospital health care network, a structured psychiatric evaluation was performed and a computerized neurocognitive battery administered to evaluate performance in several domains. From 18,344 youths in the recruitment pool who were aged 8 to 21 years, physically and cognitively capable of participating, and proficient in English, participants were randomly selected with stratification for age, sex, and ethnicity. A total of 9138 participants were enrolled in the study between November 1, 2009, and November 30, 2011, and 2321 endorsed psychotic symptoms: 1423 significant (psychosis spectrum) and 898 limited (psychosis limited). They had no comorbid medical conditions. They were compared with 981 participants endorsing significant other psychiatric symptoms and with 1963 typically developing children with no psychiatric or medical disorders. MAIN OUTCOMES AND MEASURES: The computerized neurocognitive battery provides accuracy and speed measures on 12 tests and speed measures alone on 2, yielding 26 measures used in a regression analysis to predict chronological age. Prediction was performed on the entire set and separately for each domain (executive, episodic memory, complex cognition, social cognition, and sensorimotor speed). RESULTS: Throughout childhood and adolescence, the psychosis spectrum group had lower predicted age compared with the typically developing group and the group with other psychiatric symptoms. The psychosis spectrum group had a greater developmental lag than the psychosis limited group. The lags were most pronounced for complex cognition and social cognition and were smallest for sensorimotor speed. CONCLUSIONS AND RELEVANCE: Individuals who endorse psychotic symptoms are neurocognitively delayed across the age range; this delay relates to symptom severity and is not prominent in other psychiatric disorders. Combined clinical and neurocognitive assessment can facilitate early detection and targeted intervention to delay or ameliorate disease progression.