Multiracial Reading the Mind in the Eyes Test (MRMET): An inclusive version of an influential measure.

Can an inclusive test of face cognition meet or exceed the psychometric properties of a prominent less inclusive test? Here, we norm and validate an updated version of the influential Reading the Mind in the Eyes Test (RMET), a clinically significant neuropsychiatric paradigm that has long been used to assess theory of mind and social cognition. Unlike the RMET, our Multiracial Reading the Mind in the Eyes Test (MRMET) incorporates racially inclusive stimuli, nongendered answer choices, ground-truth referenced answers, and more accessible vocabulary. We show, via a series of large datasets, that the MRMET meets or exceeds RMET across major psychometric indices. Moreover, the reliable signal captured by the two tests is statistically indistinguishable, evidence for full interchangeability. We thus present the MRMET as a high-quality, inclusive, normed and validated alternative to the RMET, and as a case in point that inclusivity in psychometric tests of face cognition is an achievable aim. The MRMET test and our normative and validation data sets are openly available under a CC-BY-SA 4.0 license at osf.io/ahq6n.

Cognitive test scores vary with choice of personal digital device.

Mobile- and web-based psychological research are a valuable addition to the set of tools available for scientific study, reducing logistical barriers for research participation and allowing the recruitment of larger and more diverse participant groups. However, this comes at the cost of reduced control over the technology used by participants, which can introduce new sources of variability into study results. In this study, we examined differences in measured performance on timed and untimed cognitive tests between users of common digital devices in 59,587 (Study 1) and 3818 (Study 2) visitors to TestMyBrain.org , a web-based cognitive testing platform. Controlling for age, gender, educational background, and cognitive performance on an untimed vocabulary test, users of mobile devices, particularly Android smartphones, showed significantly slower performance on tests of reaction time than users of laptop and desktop computers, suggesting that differences in device latency affect measured reaction times. Users of devices that differ in user interface (e.g. screen size, mouse vs. touchscreen) also show significant differences (p < 0.001) in measured performance on tests requiring fast reactions or fine motor movements. By quantifying the contribution of device differences to measured cognitive performance in an online setting, we hope to improve the accuracy of mobile- and web-based cognitive assessments, allowing these methods to be used more effectively.

Hemifield-specific control of spatial attention and working memory: Evidence from hemifield crossover costs.

Attentional tracking and working memory tasks are often performed better when targets are divided evenly between the left and right visual hemifields, rather than contained within a single hemifield (Alvarez & Cavanagh, 2005; Delvenne, 2005). However, this bilateral field advantage does not provide conclusive evidence of hemifield-specific control of attention and working memory, because it can be explained solely from hemifield-limited spatial interference at early stages of visual processing. If control of attention and working memory is specific to each hemifield, maintaining target information should become more difficult as targets move between the two hemifields. Observers in the present study maintained targets that moved either within or between the left and right hemifields, using either attention (Experiment 1) or working memory (Experiment 2). Maintaining spatial information was more difficult when target items moved between the hemifields compared with when target items moved within their original hemifields, consistent with hemifield-specific control of spatial attention and working memory. However, this pattern was not found for maintaining identity information (e.g., color) in working memory (Experiment 3). Together, these results provide evidence that control of spatial attention and working memory is specific to each hemifield, and that hemifield-specific control is a unique signature of spatial processing.

Training enhances attentional expertise, but not attentional capacity: Evidence from content-specific training benefits.

Cognitive training has become a billion-dollar industry with the promise that exercising a cognitive faculty (e.g., attention) on simple "brain games" will lead to improvements on any task relying on the same faculty. Although this logic seems sound, it assumes performance improves on training tasks because attention's capacity has been enhanced. Alternatively, training may result in attentional expertise-an enhancement of the ability to deploy attention to particular content-such that improvement on training tasks is specific to the features of the training context. The present study supported this attentional expertise hypothesis, showing that training benefits did not generalize fully from a trained attentional tracking task to untrained tracking tasks requiring a common attentional capacity, but differing in seemingly superficial features (i.e., retinotopic location and or motion type). This specificity suggests that attentional training benefits are linked to enhanced coordination between attentional processes and content-specific perceptual representations. Thus, these results indicate that shared attentional capacity between tasks is insufficient for producing generalized training benefits, and predict that generalization requires attentional expertise for content present in both training and outcome tasks.

Evaluating the Reliability and Validity of the Famous Faces Doppelgangers Test, a Novel Measure of Familiar Face Recognition.

Face recognition assessments that use images of celebrities require not only face recognition ability but also pop-culture knowledge and successful recall of identifying information. Here, we introduce a task designed to measure face recognition more specifically: the Famous Faces Doppelgangers Test (FFDT). Participants (N = 57,407) identified 40 celebrities paired with lookalike doppelgangers, allowing face recognition ability to be assessed without requiring information recall. In addition, participants reported whether they were familiar with each celebrity, allowing poor face recognition ability to be differentiated from low pop-culture knowledge. FFDT performance was reliable (rxx = .80), similar across participants of different racial and ethnic groups, and more highly correlated with memory for faces (r = .50) and self-reported face recognition ability (r = .48) than processing speed ability (r = .10). Thus, the FFDT is a reliable, valid, and specific measure of the ability to identify familiar faces, making it a promising new tool for assessing face recognition ability.

Association of Retrospectively Reported Concussion Symptoms with Objective Cognitive Performance in Former American-Style Football Players.

OBJECTIVE: Sustaining concussions has been linked to health issues later in life, yet evidence for associations between contact sports exposure and long-term cognitive performance is mixed. This cross-sectional study of former professional American-style football players tested the association of several measures of football exposure with later life cognitive performance, while also comparing the cognitive performance of former players to nonplayers. METHODS: In total, 353 former professional football players (Mage = 54.3) completed both (1) an online cognitive test battery measuring objective cognitive performance and (2) a survey querying demographic information, current health conditions, and measures of past football exposure, including recollected concussion symptoms playing professional football, diagnosed concussions, years of professional play, and age of first football exposure. Testing occurred an average of 29 years after former players' final season of professional play. In addition, a comparison sample of 5,086 male participants (nonplayers) completed one or more cognitive tests. RESULTS: Former players' cognitive performance was associated with retrospectively reported football concussion symptoms (rp = -0.19, 95% CI -0.09 to -0.29; p < 0.001), but not with diagnosed concussions, years of professional play, or age of first football exposure. This association could be due to differences in pre-concussion cognitive functioning, however, which could not be estimated based on available data. CONCLUSIONS: Future investigations of the long-term outcomes of contact sports exposure should include measures of sports-related concussion symptoms, which were more sensitive to objective cognitive performance than other football exposure measures, including self-reported diagnosed concussions.

Glycemic Variability and Fluctuations in Cognitive Status in Adults With Type 1 Diabetes (GluCog): Observational Study Using Ecological Momentary Assessment of Cognition.

BACKGROUND: Individuals with type 1 diabetes represent a population with important vulnerabilities to dynamic physiological, behavioral, and psychological interactions, as well as cognitive processes. Ecological momentary assessment (EMA), a methodological approach used to study intraindividual variation over time, has only recently been used to deliver cognitive assessments in daily life, and many methodological questions remain. The Glycemic Variability and Fluctuations in Cognitive Status in Adults with Type 1 Diabetes (GluCog) study uses EMA to deliver cognitive and self-report measures while simultaneously collecting passive interstitial glucose in adults with type 1 diabetes. OBJECTIVE: We aimed to report the results of an EMA optimization pilot and how these data were used to refine the study design of the GluCog study. An optimization pilot was designed to determine whether low-frequency EMA (3 EMAs per day) over more days or high-frequency EMA (6 EMAs per day) for fewer days would result in a better EMA completion rate and capture more hypoglycemia episodes. The secondary aim was to reduce the number of cognitive EMA tasks from 6 to 3. METHODS: Baseline cognitive tasks and psychological questionnaires were completed by all the participants (N=20), followed by EMA delivery of brief cognitive and self-report measures for 15 days while wearing a blinded continuous glucose monitor. These data were coded for the presence of hypoglycemia (<70 mg/dL) within 60 minutes of each EMA. The participants were randomized into group A (n=10 for group A and B; starting with 3 EMAs per day for 10 days and then switching to 6 EMAs per day for an additional 5 days) or group B (N=10; starting with 6 EMAs per day for 5 days and then switching to 3 EMAs per day for an additional 10 days). RESULTS: A paired samples 2-tailed t test found no significant difference in the completion rate between the 2 schedules (t17=1.16; P=.26; Cohen dz=0.27), with both schedules producing >80% EMA completion. However, more hypoglycemia episodes were captured during the schedule with the 3 EMAs per day than during the schedule with 6 EMAs per day. CONCLUSIONS: The results from this EMA optimization pilot guided key design decisions regarding the EMA frequency and study duration for the main GluCog study. The present report responds to the urgent need for systematic and detailed information on EMA study designs, particularly those using cognitive assessments coupled with physiological measures. Given the complexity of EMA studies, choosing the right instruments and assessment schedules is an important aspect of study design and subsequent data interpretation.

Toward dynamic phenotypes and the scalable measurement of human behavior.

Precision psychiatry demands the rapid, efficient, and temporally dense collection of large scale and multi-omic data across diverse samples, for better diagnosis and treatment of dynamic clinical phenomena. To achieve this, we need approaches for measuring behavior that are readily scalable, both across participants and over time. Efforts to quantify behavior at scale are impeded by the fact that our methods for measuring human behavior are typically developed and validated for single time-point assessment, in highly controlled settings, and with relatively homogeneous samples. As a result, when taken to scale, these measures often suffer from poor reliability, generalizability, and participant engagement. In this review, we attempt to bridge the gap between gold standard behavioral measurements in the lab or clinic and the large-scale, high frequency assessments needed for precision psychiatry. To do this, we introduce and integrate two frameworks for the translation and validation of behavioral measurements. First, borrowing principles from computer science, we lay out an approach for iterative task development that can optimize behavioral measures based on psychometric, accessibility, and engagement criteria. Second, we advocate for a participatory research framework (e.g., citizen science) that can accelerate task development as well as make large-scale behavioral research more equitable and feasible. Finally, we suggest opportunities enabled by scalable behavioral research to move beyond single time-point assessment and toward dynamic models of behavior that more closely match clinical phenomena.

The TestMyBrain Digital Neuropsychology Toolkit: Development and Psychometric Characteristics.

INTRODUCTION: To allow continued administration of neuropsychological evaluations remotely during the pandemic, tests from the not-for-profit platform, TestMyBrain.org (TMB), were used to develop the TMB Digital Neuropsychology Toolkit (DNT). This study details the psychometric characteristics of the DNT, as well as the infrastructure and development of the DNT. METHOD: The DNT was primarily distributed for clinical use, with (72.8%) of individuals requesting access for clinical purposes. To assess reliability and validity of the DNT, anonymous data from DNT test administrations were analyzed and compared to a large, non-clinical normative sample from TMB. RESULTS: DNT test scores showed acceptable to very good split-half reliability (.68-.99). Factor analysis revealed three latent factors, corresponding to processing speed, working memory, and a broader general cognitive ability factor that included perceptual reasoning and episodic memory. Average test scores were slightly poorer for the DNT sample than for the TMB comparison sample, as expected given the clinical use of the DNT. CONCLUSIONS: Initial estimates of reliability and validity of DNT tests support their use as digital measures of neuropsychological functioning. Tests within cognitive domains correlated highly with each other and demonstrated good reliability and validity. Future work will seek to validate DNT tests in specific clinical populations and determine best practices for using DNT outcome measures to assess engagement and psychological symptomatology.

Development of multiple object tracking via multifocal attention.

Multifocal attention is the ability to simultaneously attend to multiple objects, and is critical for typical functioning. Although adults are able to use multifocal attention, little is known about the development of this ability. In two experiments, we investigated multifocal attention in 6-8-year-old children and adults using a child-friendly, computerized multiple object tracking task designed to encourage the use of multifocal attention. We also investigated whether multifocal attention in children is deployed independently across left and right hemifields of vision, as in adults. Our results suggest that children's capacity for multifocal attention increases significantly across middle childhood. We also found evidence that at least one signature of hemifield-independent multifocal attention, the bilateral field advantage, can be observed in children. (PsycInfo Database Record (c) 2020 APA, all rights reserved).