Sensitivity of the African neuropsychology battery memory subtests and learning slopes in discriminating APOE 4 and amyloid pathology in adult individuals in the Democratic Republic of Congo.

Background: The current study examined the sensitivity of two memory subtests and their corresponding learning slope metrics derived from the African Neuropsychology Battery (ANB) to detect amyloid pathology and APOEε4 status in adults from Kinshasa, the Democratic Republic of the Congo. Methods: 85 participants were classified for the presence of ß-amyloid pathology and based on allelic presence of APOEε4 using Simoa. All participants were screened using CSID and AQ, underwent verbal and visuospatial memory testing from ANB, and provided blood samples for plasma Aß42, Aß40, and APOE proteotype. Pearson correlation, linear and logistic regression were conducted to compare amyloid pathology and APOEε4 status with derived learning scores, including initial learning, raw learning score, learning over trials, and learning ratio. Results: Our sample included 35 amyloid positive and 44 amyloid negative individuals as well as 42 without and 39 with APOEε4. All ROC AUC ranges for the prediction of amyloid pathology based on learning scores were low, ranging between 0.56-0.70 (95% CI ranging from 0.44-0.82). The sensitivity of all the scores ranged between 54.3-88.6, with some learning metrics demonstrating good sensitivity. Regarding APOEε4 prediction, all AUC values ranged between 0.60-0.69, with all sensitivity measures ranging between 53.8-89.7. There were minimal differences in the AUC values across learning slope metrics, largely due to the lack of ceiling effects in this sample. Discussion: This study demonstrates that some ANB memory subtests and learning slope metrics can discriminate those that are normal from those with amyloid pathology and those with and without APOEε4, consistent with findings reported in Western populations.

Detecting feigned cognitive impairment using pupillometry on the Warrington Recognition Memory Test for Words.

OBJECTIVE: Pupillometry provides information about physiological and psychological processes related to cognitive load, familiarity, and deception, and it is outside of conscious control. This study examined pupillary dilation patterns during a performance validity test (PVT) among adults with true and feigned impairment of traumatic brain injury (TBI). PARTICIPANTS AND METHODS: Participants were 214 adults in three groups: adults with bona fide moderate to severe TBI (TBI; n = 51), healthy comparisons instructed to perform their best (HC; n = 72), and healthy adults instructed and incentivized to simulate cognitive impairment due to TBI (SIM; n = 91). The Recognition Memory Test (RMT) was administered in the context of a comprehensive neuropsychological battery. Three pupillary indices were evaluated. Two pure pupil dilation (PD) indices assessed a simple measure of baseline arousal (PD-Baseline) and a nuanced measure of dynamic engagement (PD-Range). A pupillary-behavioral index was also evaluated. Dilation-response inconsistency (DRI) captured the frequency with which examinees displayed a pupillary familiarity response to the correct answer but selected the unfamiliar stimulus (incorrect answer). RESULTS: All three indices differed significantly among the groups, with medium-to-large effect sizes. PD-Baseline appeared sensitive to oculomotor dysfunction due to TBI; adults with TBI displayed significantly lower chronic arousal as compared to the two groups of healthy adults (SIM, HC). Dynamic engagement (PD-Range) yielded a hierarchical structure such that SIM were more dynamically engaged than TBI followed by HC. As predicted, simulators engaged in DRI significantly more frequently than other groups. Moreover, subgroup analyses indicated that DRI differed significantly for simulators who scored in the invalid range on the RMT (n = 45) versus adults with genuine TBI who scored invalidly (n = 15). CONCLUSIONS: The findings support continued research on the application of pupillometry to performance validity assessment: Overall, the findings highlight the promise of biometric indices in multimethod assessments of performance validity.

Semantic clustering on common list-learning tasks: a systematic review of the state of the literature and recommendations for future directions.

INTRODUCTION: On some list-learning tasks, such as the California Verbal Learning Test (CVLT) or Hopkins Verbal Learning Test (HVLT), examinees have the opportunity to group words based on semantically related categories (i.e., semantic clustering). Semantic clustering (SC) is often considered the most efficient organizational strategy and adopting SC is presumed to improve learning and memory. In addition, SC is conceptualized as reflecting higher-order executive functioning skills. Although SC measures have intuitive appeal, to date, there are no comprehensive reviews of the SC literature base that summarize its psychometric utility. In this systematic review, we synthesize the literature to judge the validity of SC scores. METHOD: We conducted a systematic literature search for empirical articles reporting SC from the CVLT and HVLT. We qualitatively described the relationship of SC with other list-learning and cognitive test scores and clinical diagnoses, contrasting SC with serial clustering and total learning scores when possible. RESULTS: SC was inversely correlated with serial clustering. Higher SC was strongly associated with better learning and memory performances. When compared with cognitive tests, SC tended to have the strongest relationships with other memory measures and modest relationships with tests of executive functioning. SC had negligible to small relationships with most other cognitive domains. Traditional memory scores yielded stronger relationships to cognitive test performances than did SC. SC across clinical groups varied widely, but clinical groups tended to use SC less often than healthy comparison groups. CONCLUSION: Our comprehensive review of the literature revealed that SC is strongly related to measures of learning and memory on the CVLT and HVLT and is correlated with a wide range of cognitive functions. SC has been understudied in relevant populations and additional research is needed to test the degree to which it adds incremental validity beyond traditional measures of learning and memory.

A quantitative review of competing learning slope metrics: effects of age, sex, and clinical diagnosis.

INTRODUCTION: In learning and memory tests that involve multiple presentations of the same material, learning slope refers to the degree to which examinees improve performances over successive learning trials. We aimed to quantitatively review the traditional raw learning slope (RLS), and the newly created learning ratio (LR) to understand the effects of demographic variables and clinical diagnoses on learning slope (e.g., limited improvement over multiple trials), and to develop demographically sensitive norms. METHOD: A systematic literature search was conducted to evaluate the potential for these aims to be examined across the most popular contemporary multi-trial learning tests. Two databases were searched. Following this, hierarchical linear modeling was used to examine how demographic variables predict learning slope indices. These results were in turn used to contrast the performance of clinical groups with the predicted performance of demographically similar healthy controls. Finally, preliminary normative estimates for learning slope indices were presented. RESULTS: A total of 82 studies met criteria for inclusion in this study. However, the Rey Auditory Verbal Learning Test (RAVLT) was the only test to have sufficient trial-level learning and demographic data. Fifty-eight samples from 19 studies were quantitatively examined. Hierarchical linear models provided evidence of sex differences and a curvilinear decline in learning slope with age, with strongest and most consistent effects for LR relative to RLS. Regression-based norms for demographically corrected RLS and LR scores for the RAVLT are presented. The effect of clinical diagnoses was consistently stronger for LR, and Alzheimer's disease had the strongest effect, followed by invalid performances, severe traumatic brain injury, and seizures/epilepsy. CONCLUSION: Overall, LR enjoys both conceptual and demonstrated psychometric advantages over RLS. Replication of these findings can be completed by reanalyzing existing datasets. Further work may focus on the utility of using LR in diagnosis and prediction of clinical prognosis.

Measurement invariance of physical, mental, and social health PROMIS measures across individuals with spinal cord injury and traumatic brain injury.

PURPOSE: The present study tested the fit and comparability of the tripartite model of health (Physical Health, Mental Health, and Social Health) proposed by the NIH PROMIS for adults with SCI and TBI. METHODS: Participants were 630 adults with spinal cord injury (SCI; n = 336) and traumatic brain injury (TBI; n = 294) who completed 8 PROMIS short forms. The Physical Health domain is composed of the Physical Function, Pain Interference, and Fatigue scales. The Mental Health domain included the Depression, Anxiety, and Anger scales. Social Health included the Social Emotional Support scale. RESULTS: Confirmatory factor analyses supported the tripartite model of health over a unifactorial model of health for both SCI and TBI groups. Measurement invariance testing indicated the tripartite model met the level of configural and metric invariance for TBI and SCI groups, suggesting comparable structure and factor loadings. Failure to meet the level of scalar invariance indicated unequal intercepts across groups. Physical Function was identified as the source of noninvariance, and a partial scalar invariance model permitting different Physical Function intercepts across conditions was supported. CONCLUSION: Consistent with theory, findings supported construct validity of the PROMIS tripartite structure of health composed of Physical, Mental, and Social Health. PROMIS measures appeared to tap domains of health consistent with what is accepted for SCI and TBI populations, although the measurement of Physical Function was not equivalent across groups. Findings support the utility of PROMIS broadly as well as the need for condition-optimized measurement.

Utility of WAIS-IV Digit Span indices as measures of performance validity in moderate to severe traumatic brain injury.

Objective: The addition of Sequencing to WAIS-IV Digit Span (DS) brought about new Reliable Digit Span (RDS) indices and an Age-Corrected Scaled Score that includes Sequencing trials. Reports have indicated that these new performance validity tests (PVTs) are superior to the traditional RDS; however, comparisons in the context of known neurocognitive impairment are sparse. This study compared DS-derived PVT classification accuracies in a design that included adults with verified TBI. Methods: Participants included 64 adults with moderate-to-severe TBI (TBI), 51 healthy adults coached to simulate TBI (SIM), and 78 healthy comparisons (HC). Participants completed the WAIS-IV DS subtest in the context of a larger test battery. Results: Kruskal-Wallis tests indicated that all DS indices differed significantly across groups. Post hoc contrasts revealed that only RDS Forward and the traditional RDS differed significantly between SIM and TBI. ROC analyses indicated that RDS variables were comparable predictors of SIM vs. HC; however, the traditional RDS showed the highest sensitivity when approximating 90% specificity for SIM vs. TBI. A greater percentage of TBI scored RDS Sequencing < 1 compared to SIM and HC. Conclusion: In the context of moderate-to-severe TBI, the DS-derived PVTs showed comparable discriminability. However, the Greiffenstein et al. traditional RDS demonstrated the best classification accuracy with respect to specificity/sensitivity balance. This relative superiority may reflect that individuals with verified TBI are more likely to perseverate on prior instructions during DS Sequencing. Findings highlight the importance of including individuals with verified TBI when evaluating and developing PVTs.

Time and money: Exploring enhancements to performance validity research designs.

INTRODUCTION: The study examined the effect of preparation time and financial incentives on healthy adults' ability to simulate traumatic brain injury (TBI) during neuropsychological evaluation. METHOD: A retrospective comparison of two TBI simulator group designs: a traditional design employing a single-session of standard coaching immediately before participation (SIM-SC; n = 46) and a novel design that provided financial incentive and preparation time (SIM-IP; n = 49). Both groups completed an ecologically valid neuropsychological test battery that included widely-used cognitive tests and five common performance validity tests (PVTs). RESULTS: Compared to SIM-SC, SIM-IP performed significantly worse and had higher rates of impairment on tests of processing speed and executive functioning (Trails A and B). SIM-IP were more likely than SIM-SC to avoid detection on one of the PVTs and performed somewhat better on three of the PVTs, but the effects were small and non-significant. SIM-IP did not demonstrate significantly higher rates of successful simulation (i.e., performing impaired on cognitive tests with <2 PVT failures). Overall, the rate of the successful simulation was ∼40% with a liberal criterion, requiring cognitive impairment defined as performance >1 SD below the normative mean. At a more rigorous criterion defining impairment (>1.5 SD below the normative mean), successful simulation approached 35%. CONCLUSIONS: Incentive and preparation time appear to add limited incremental effect over traditional, single-session coaching analog studies of TBI simulation. Moreover, these design modifications did not translate to meaningfully higher rates of successful simulation and avoidance of detection by PVTs.

Detecting simulated versus bona fide traumatic brain injury using pupillometry.

Objective: Pupil dilation patterns are outside of conscious control and provide information regarding neuropsychological processes related to deception, cognitive effort, and familiarity. This study examined the incremental utility of pupillometry on the Test of Memory Malingering (TOMM) in classifying individuals with verified traumatic brain injury (TBI), individuals simulating TBI, and healthy comparisons. Method: Participants were 177 adults across three groups: verified TBI (n = 53), feigned cognitive impairment due to TBI (SIM, n = 52), and heathy comparisons (HC, n = 72). Results: Logistic regression and ROC curve analyses identified several pupil indices that discriminated the groups. Pupillometry discriminated best for the comparison of greatest clinical interest, verified TBI versus simulators, adding information beyond traditional accuracy scores. Simulators showed evidence of greater cognitive load than both groups instructed to perform at their best ability (HC and TBI). Additionally, the typically robust phenomenon of dilating to familiar stimuli was relatively diminished among TBI simulators compared to TBI and HC. This finding may reflect competing, interfering effects of cognitive effort that are frequently observed in pupillary reactivity during deception. However, the familiarity effect appeared on nearly half the trials for SIM participants. Among those trials evidencing the familiarity response, selection of the unfamiliar stimulus (i.e., dilation-response inconsistency) was associated with a sizeable increase in likelihood of being a simulator. Conclusions: Taken together, these findings provide strong support for multimethod assessment: adding unique performance assessments such as biometrics to standard accuracy scores. Continued study of pupillometry will enhance the identification of simulators who are not detected by traditional performance validity test scoring metrics. (PsycInfo Database Record (c) 2021 APA, all rights reserved).

Performance validity assessment using response time on the Warrington Recognition Memory Test.

OBJECTIVE: The present study tested the incremental utility of response time (RT) on the Warrington Recognition Memory Test - Words (RMT-W) in classifying bona fide versus feigned TBI. METHOD: Participants were 173 adults: 55 with moderate to severe TBI, 69 healthy comparisons (HC) instructed to perform their best, and 49 healthy adults coached to simulate TBI (SIM). Participants completed a computerized version of the RMT-W in the context of a comprehensive neuropsychological battery. Groups were compared on RT indices including mean RT (overall, correct trials, incorrect trials) and variability, as well as the traditional RMT-W accuracy score. RESULTS: Several RT indices differed significantly across groups, although RMT-W accuracy predicted group membership more strongly than any individual RT index. SIM showed longer average RT than both TBI and HC. RT variability and RT for incorrect trials distinguished SIM-HC but not SIM-TBI comparisons. In general, results for SIM-TBI comparisons were weaker than SIM-HC results. For SIM-HC comparisons, classification accuracy was excellent for all multivariable models incorporating RMT-W accuracy with one of the RT indices. For SIM-TBI comparisons, classification accuracies for multivariable models ranged from acceptable to excellent discriminability. In addition to mean RT and RT on correct trials, the ratio of RT on correct items to incorrect items showed incremental predictive value to accuracy. CONCLUSION: Findings support the growing body of research supporting the value of combining RT with PVTs in discriminating between verified and feigned TBI. The diagnostic accuracy of the RMT-W can be improved by incorporating RT.

Detecting feigned traumatic brain injury with eye tracking during a test of performance validity.

OBJECTIVE: Eye-tracking is a promising technology to enhance assessment of performance validity. Research has established that ocular behaviors are reliable biomarkers of (un)conscious cognitive processes, and they have distinguished deceptive from honest responding in experimental paradigms. This study examined the incremental utility of eye-tracking on a clinical performance validity test (PVT) in distinguishing adults with verified TBI from adults coached to feign cognitive impairment. METHOD: Participants were 49 adults with moderate-to-severe TBI (TBI), 47 healthy adults coached to simulate TBI (SIM), and 67 healthy comparisons providing full effort (HC). A PVT linked to eye-tracking was completed in the context of a full neuropsychological battery. RESULTS: Kruskal-Wallis tests revealed that eye-tracking indices did not differ among the groups during presentation of stimulus items but did differ during forced-choice trials. Compared to TBI and HC, SIM had significantly more transitions, fixations, and time spent looking at correct and incorrect response options. Logistic regressions and ROC curve analyses showed that accuracy was the best predictor of SIM versus HC. For SIM versus TBI, eye-tracking indices exceeded accuracy in distinguishing the groups. Eye-tracking added incremental predictive value to accuracy for both SIM-HC and SIM-TBI discriminations. CONCLUSION: Eye-tracking indicated that persons feigning TBI showed multiple signs of greater cognitive effort than persons with verified TBI and healthy comparisons. In the comparison of greatest interest (SIM vs. TBI) eye-tracking best predicted group status and yielded excellent discrimination when combined with accuracy. Eye-tracking may be an important complement to traditional accuracy scores on PVTs. (PsycINFO Database Record (c) 2020 APA, all rights reserved).

Will Not Want: Self-Control Rather than Motivation Explains the Female Advantage in Report Card Grades.

Girls earn better grades than boys, but the mechanism explaining this gender difference is not well understood. We examined the relative importance of self-control and motivation in explaining the female advantage in grades. In Study 1, we surveyed middle school teachers and found they judged girls to be higher in both school motivation and self-control. In Studies 2 and 3-using self-reported motivation and teacher- and/or parent-reported self-control, and quarterly and final grades obtained from school records-we find that self-control, but not school motivation, helps to explain the gender gap in academic performance. In these studies, girls appeared to be more self-controlled than boys, but-contrary to teacher judgments in Study 1-did not appear to be more motivated to do well in school.

A Behind-the-Scenes Guide to School-Based Research.

Schools are an important context for both basic and applied scientific research. Unlike the laboratory, however, the physical and social conditions of schools are not under the exclusive control of scientists. In this article, we liken collecting data in schools to putting on a theatrical production. We begin by describing the large cast of characters whose collaborative efforts make school-based research possible. Next, we address the critics, including the university Institutional Review Board (IRB) and school administrators, whose feedback often improves the final study design. We then turn our attention to set building, stage directions, and rehearsals - key steps in the iterative process of refining study procedures. We end with a discussion of the day of data collection itself and activities that take place after the curtain drops. Throughout, we make recommendations based on our recent experience collecting data at several high schools. All the world's a stage~William Shakespeare, As You Like It, 2.7.139.