Cross-validating the Dot Counting Test Among an Adult ADHD Clinical Sample and Analyzing the Effect of ADHD Subtype and Comorbid Psychopathology.

This study cross-validated the dot counting test (DCT) as a performance validity test (PVT) in an adult attention-deficit/hyperactivity disorder (ADHD) clinical population and examined the effect of ADHD subtype and psychiatric comorbidity on accuracy for detecting invalidity. DCT performance was assessed among 210 consecutive adult ADHD referrals who underwent neuropsychological evaluation and were classified into valid (n = 175) or invalid (n = 35) groups based on seven independent criterion PVTs. The invalid group had significantly worse DCT performance than the valid group using both the standard and unrounded scoring procedure (ηp2=.28). Classification accuracy was excellent, with 54.3% sensitivity/92% specificity at optimal cut-scores of ≥14 (rounded) and ≥13.38 (unrounded). Nonsignificant DCT performance differences emerged based on ADHD subtype or the presence/absence of comorbid psychopathology. The DCT functions well as a nonmemory-based PVT in an ethnoracially diverse ADHD population, supporting its clinical utility for detecting invalid neurocognitive performance during ADHD evaluations.

Concordance between the Minnesota Multiphasic Personality Inventory-2-Restructured Form (MMPI-2-RF) and Clinical Assessment of Attention Deficit-Adult (CAT-A) over-reporting validity scales for detecting invalid ADHD symptom reporting.

This study investigated the relationship between symptom validity scales on the Clinical Assessment of Attention Deficit-Adult (CAT-A) and the Minnesota Multiphasic Personality Inventory-2-Restructured Form (MMPI-2-RF) in the context of Attention-Deficit/Hyperactivity Disorder (ADHD) evaluation. The sample comprised 140 consecutive patients referred for a neuropsychological evaluation of ADHD and were administered the CAT-A and the MMPI-2-RF and a battery of performance-based neurocognitive tests. Results indicated CAT-A/MMPI-2-RF symptom validity concordance of 51% between measures, with 38% concordant valid and 13% concordant invalid responses. Among those with discordance symptom validity results, rates of valid CAT-A/invalid MMPI-2-RF responding (41%) were more common than invalid CAT-A/valid MMPI-2-RF responding (8%). Results also indicated higher levels of ADHD symptoms among invalid responding within the CAT-A, whereas the MMPI-2-RF Cognitive Complaints scale did not differ by CAT-A validity status. Finally, symptom validity scales on both the CAT-A and MMPI-2-RF were largely discordant from neuropsychological test validity status per performance validity tests. Findings highlight the need for symptom validity testing when assessing ADHD and indicate that validity indices on broad personality assessments may assess different constructs than embedded validity indices in ADHD-specific measures.

Cross-validation of a forced-choice validity indicator to enhance the clinical utility of the Rey Auditory Verbal Learning Test.

A forced-choice (FC) recognition trial was recently developed as an embedded validity indicator for the Rey Auditory Verbal Learning Test (RAVLT), although it has not been replicated outside of the initial validation study. This study cross-validated the RAVLT FC trial for detecting invalid neuropsychological test performance and assessed the degree to which material-specific verbal memory impairment severity impacts its classification accuracy as a performance validity test (PVT). This cross-sectional study included 172 neuropsychiatric patients who completed the RAVLT and 4 independent criterion PVTs, which were used to classify validity groups (134 valid/38 invalid). Overall results showed the RAVLT FC had excellent classification accuracy for detecting invalid performance at a ≤13 cut-score (66% sensitivity/87% specificity). When patients were subdivided by memory impairment status, FC retained excellent classification accuracy among the normal memory and mild memory impairment groups with 66%-82% sensitivity and ≥89% specificity. Accuracy decreased among those with severe memory impairment, but remained significant with a lower, alternative cut-score of ≤11 (37% sensitivity/88% specificity). Findings were consistent with FC trials developed for other memory measures and support the utility of this novel RAVLT FC index for reliably identifying invalid performance, even in the context of significant verbal memory impairment. (PsycInfo Database Record (c) 2021 APA, all rights reserved).

Comparing the Psychometric Properties of Eight Embedded Performance Validity Tests in the Rey Auditory Verbal Learning Test, Wechsler Memory Scale Logical Memory, and Brief Visuospatial Memory Test-Revised Recognition Trials for Detecting Invalid Neuropsychological Test Performance.

This cross-sectional study evaluated eight embedded performance validity tests (PVTs) previously derived from the Rey Auditory Verbal Learning Test (RAVLT), Wechsler Memory Scale-IV-Logical Memory (LM), and Brief Visuospatial Memory Test-Revised (BVMT-R) recognition trials among a single mixed clinical sample of 108 neuropsychiatric patients (83 valid/25 invalid) with (n = 54) and without (n = 29) mild neurocognitive disorder. Among the overall sample, all eight recognition PVTs significantly differentiated valid from invalid performance (areas under the curve [AUCs] = .64-.81) with 26% to 44% sensitivity (≥89% specificity) at optimal cut-scores depending on the specific PVT. After subdividing the sample by cognitive impairment status, all eight PVTs continued to reliably identify invalid performance (AUC = .68-.91) with markedly increased sensitivities of 56% to 80% (≥89% specificity) in the unimpaired group. In contrast, among those with mild neurocognitive disorder, RAVLT False Positives and LM became nonsignificant, whereas the other six PVTs remained significant (AUC = .64-.77), albeit with reduced sensitivities of 32% to 44% (≥89% specificity) at optimal cut-scores. Taken together, results cross-validated BVMT-R and most RAVLT recognition indices as effective embedded PVTs for identifying invalid neuropsychological test performance with diverse populations including examinees with and without suspected mild neurocognitive disorder, whereas LM had more limited utility as an embedded PVT, particularly when mild neurocognitive disorder was present.

Out of sight, out of mind: The impact of material-specific memory impairment on Rey 15-Item Test performance.

This study examined the effect of increasing material-specific verbal and visual memory impairment severity on Rey 15-Item Test (RFIT) and RFIT/Recognition Trial performance. Data from 146 clinically referred patients (109 valid/37 invalid) who completed the RFIT, Brief Visuospatial Memory Test-Revised, and Rey Auditory Verbal Learning Test were analyzed. Rey Auditory Verbal Learning Test/BVMT memory impairment was operationalized as ≥40T (no memory impairment), 30T-39T (mild memory impairment), or ≤29T (severe memory impairment). Medium-to-large correlations emerged between the RFIT and memory measures. Significantly more patients with impaired visual memory, and to a lesser extent verbal memory, failed the RFIT and RFIT/Recognition. RFIT and RFIT/Recognition produced areas under the curve = .80-.90 for detecting invalidity and strong associated psychometric properties among patients without memory impairment, but both yielded low and largely unacceptable accuracy (areas under the curve = .57-.71) when verbal or visual memory impairment of any severity was present. In sum, RFIT performance was significantly affected by increasing material-specific memory deficits, such that it produced acceptable accuracy among unimpaired patients, but accuracy greatly diminished with memory impairment, which is antithetical to a sound performance validity test. (PsycInfo Database Record (c) 2020 APA, all rights reserved).