Cognitive "success" in the setting of performance validity test failure.

BACKGROUND: Although studies have shown unique variance contributions from performance invalidity, it is difficult to interpret the meaning of cognitive data in the setting of performance validity test (PVT) failure. The current study aimed to examine cognitive outcomes in this context. METHOD: Two hundred and twenty-two veterans with a history of mild traumatic brain injury referred for clinical evaluation completed cognitive and performance validity measures. Standardized scores were characterized as Within Normal Limits (≥16th normative percentile) and Below Normal Limits (<16th percentile). Cognitive outcomes are examined across four commonly used PVTs. Self-reported employment and student status were used as indicators of "productivity" to assess potential functional differences related to lower cognitive performance. RESULTS: Among participants who performed in the invalid range on Test of Memory Malingering trial 1, Word Memory Test, Wechsler Adult Intelligence Scale-Fourth Edition Digit Span aged corrected scaled score, and the California Verbal Learning Test-Second Edition Forced Choice index, 16-88% earned broadly within normal limits scores across cognitive testing. Depending on which PVT measure was applied, the average number of cognitive performances below the 16th percentile ranged from 5 to 7 of 14 tasks. There were no differences in the total number of below normal limits performances on cognitive measures between "productive" and "non-productive" participants (T = 1.65, p = 1.00). CONCLUSIONS: Results of the current study suggest that the range of within normal limits cognitive performance in the context of failed PVTs varies greatly. Importantly, our findings indicate that neurocognitive data may still provide important practical information regarding cognitive abilities, despite poor PVT outcomes. Further, given that rates of below normal limits cognitive performance did not differ among "productivity" groups, results have important implications for functional abilities and recommendations in a clinical setting.

Varying failure criteria on performance validity tests influences interpretation of cognitive outcomes.

OBJECTIVE: The present study examined the effects of applying various performance validity tests (PVT) failure criteria on the relationship between cognitive outcomes and posttraumatic stress (PTS) symptomology. METHOD: One hundred and ninety-nine veterans with a history of mild traumatic brain injury referred for clinical evaluation completed cognitive tests, PVTs, and self-report measures of PTS symptoms and symptom exaggeration. Normative T scores of select cognitive tests were averaged into memory, attention/processing speed, and executive functioning composites. Separate one way analyses of variance assessed differences among high PTS (n = 140) versus low PTS (n = 59) groups and were repeated excluding participants based on varying combinations of PVT failure criteria. RESULTS: When no PVTs were considered, the high PTS group demonstrated worse performance across all three cognitive domains. Excluding those who failed two or more stand-alone, or two or more embedded validity measures resulted in group differences across all cognitive composites. When participants were excluded based on failure of any one embedded and any one stand-alone PVT measure combined, the high PTS group performed worse on the executive functioning and attention/processing speed composites. The remaining three proposed methods to control for performance validity resulted in null PTS-cognition relationships. Results remained largely consistent after controlling for symptom exaggeration. CONCLUSIONS: Methods of defining PVT failure can greatly influence differences in cognitive function between groups defined by PTS symptom levels. Findings highlight the importance of considering performance validity when interpreting cognitive data and warrant future investigation of PVT failure criteria in other conditions. (PsycInfo Database Record (c) 2023 APA, all rights reserved).

Official position of the American Academy of Clinical Neuropsychology on test security.

To provide education regarding the critical importance of test security for neuropsychological and psychological tests, and to establish recommendations for best practices for maintaining test security in forensic, clinical, teaching, and research settings. Previous test security guidelines were not adequately specified. METHOD: Neuropsychologists practicing in a broad range of settings collaborated to develop detailed and specific guidance regarding test security to best ensure continued viability of neuropsychological and psychological tests. Implications of failing to maintain test security for both the practice of neuropsychology and for society at large were identified. Types of test data that can be safely disclosed to nonpsychologists are described.Specific procedures can be followed that will minimize risk of invalidating future use of neuropsychological and psychological measures.Clinical neuropsychologists must commit to protecting sensitive neuropsychological and psychological test information from exposure to nonpsychologists, and now have specific recommendations that will guide that endeavor.

Detection of symptom over-reporting on the Neurobehavioral Symptom Inventory in OEF/OIF/OND veterans with history of mild TBI.

OBJECTIVE: As part of routine care at Veterans Affairs facilities, veterans with a service-related traumatic brain injury (TBI) are administered a self-report post-concussive symptom measure, the Neurobehavioral Symptom Inventory (NSI). Interpreting the NSI can be problematic given that over-reporting on self-report measures is often found in both civilian and military patient populations. This study investigates embedded scales on the NSI that identify possible and probable symptom exaggeration. METHOD: 183 veterans with a history of mild TBI were administered the Minnesota Multiphasic Personality Inventory, 2nd edition, Restructured Form (MMPI-2-RF) and the NSI. The participants were divided into symptom validity testing pass and fail groups based on their performance on the MMPI-2-RF symptom validity scales. Cut scores on the NSI Total and Validity-10 scores were then established and applied to two additional veteran populations. RESULTS: Sensitivity and specificity values were derived for all NSI Total and Validity-10 values. Optimal cut scores were determined based on specificity levels of ≥95%. The NSI Total cut score was ≥57 for possible and ≥67 for probable symptom exaggeration and the Validity-10 cut score was ≥22 for possible and ≥27 for probable symptom exaggeration, with sensitivity ranging from 27 to 43%. Applying these cut scores to a broader clinical and research sample resulted in lower rates of suspected exaggeration. CONCLUSIONS: Both the NSI Total and Validity-10 cut scores consistently identified potential symptom exaggeration across three mild TBI samples. Clinicians and researchers who use the NSI are encouraged to utilize either embedded validity measure in their practice.

A cohort study on protocol-based nurse-led out-patient management of post-chemotherapy low-risk febrile neutropenia.

PURPOSE: International guidelines adopt risk stratification approach to manage patients with low-risk febrile neutropenia patients. We developed this out-patient program using shared-care model with professional input and patient empowerment, so as to reduce patients' psychological burden from hospitalization and to improve the cost-effectiveness of management. METHOD: This is a prospective cohort study to compare the efficacy and safeness of the out-patient program when compared with traditional in-patient care. Patients with solid tumors, developed febrile neutropenia with Multinational Association of Supportive Care in Cancer score of at least 21, and good performance status were included. After initial assessment and the first dose of oral antibiotics, patients were observed in the ambulatory center. Stable patients were discharged home after 4 h of observation and nurse counseling. Patients' condition and clinical progress were regularly reviewed by specialist nurses within the following week by telephone and nurse clinic follow-up. The primary objective of the study is success rate, which defined as the resolution of fever and infection, without hospitalization or any change in antibiotics. RESULTS: From September 2014 to December 2016, a total of 38 patients were enrolled. Majority were female with breast cancer (97%). Two patients required hospitalization due to persistent fever. The success rate of the out-patient program was not significantly different from the historical in-patient cohort (94.9 versus 97.4%, p = 0.053). No mortality was observed. Patients' compliance to the program was 100%, to telephone follow-up, nurse clinic visits, and daily temperature record. CONCLUSION: Out-patient management of patients with low-risk febrile neutropenia is effective and safe through implementation of a structured protocol with joint inputs and engagement from clinicians, oncology nurses, and patients.

Women's leadership in neuropsychology: historical perspectives, present trends, and future directions.

OBJECTIVE: Although psychology has become a female-dominated field, this pattern of gender representation has not held true within the specialty of neuropsychology. In recent years more women have been pursuing careers in neuropsychology, and while the balance of male and female neuropsychologists as a whole has shifted, it is unclear whether the gender composition of leadership has also changed. Our goal was to survey various neuropsychological organizations, training programs, editorial boards, and organizations granting board certification to determine the current gender composition of leadership positions within neuropsychology. METHOD: A literature review was conducted to examine past trends of gender composition in neuropsychology, psychology, medicine, and academia. Data on current gender compositions of the field were culled from publicly available websites and through personal communication with representatives from major psychological and neuropsychological organizations. RESULTS: We found that the overall composition of the field has changed over time, but notable gender disparities in leadership positions remain. Women still comprise the minority of leadership positions within most neuropsychological organizations, editorial boards for neuropsychology journals, and fellow positions in major neuropsychological organizations. More equitable representation has been achieved in the directorships of training programs and ABPP/ABCN board certification. CONCLUSION: We review the historical trends in gender discrepancies in leadership in neuropsychology and discuss these within the broader arenas of academia, research, and medicine. We conclude with a summary addressing potential causes for these discrepancies, including work-life balance issues, discrimination, institutional bias, and various other factors. We also provide pragmatic suggestions to help address these continued disparities.

Relative Utility of Performance and Symptom Validity Tests.

This investigation adds to the burgeoning body of research concerned with discriminating performance and symptom validity tests (SVTs) through examination of their differential relationships with cognitive performance and symptom self-report measures. To the authors' current knowledge, prior studies have not assessed differences between participants who fail either a performance validity test (PVT) or an SVT but not both. As part of their neuropsychological evaluations at four Veterans Affairs medical centers across the United States, participants were administered a fixed, standardized battery that consisted of performance validity, symptom validity, cognitive performance, and symptom self-report measures. Compared with participants who failed a PVT and an SVT, participants who passed both and participants who only passed a PVT demonstrated better cognitive performance and self-reported fewer symptoms. Results support differential clinical utility of performance validity and SVTs when assessing cognitive performance and symptom self-report.

Factors related to satisfaction with life in veterans with mild traumatic brain injury.

PURPOSE/OBJECTIVE: Satisfaction with life (SWL) is an important measure of outcome in rehabilitation. Previous research suggests that those with a history of traumatic brain injury (TBI), even mild TBI, report lower levels of life satisfaction when compared with the noninjured population. Although is it possible that TBI has a direct effect on SWL, various medical and psychosocial factors commonly affecting those recovering from TBI likely contribute to SWL. RESEARCH METHOD/DESIGN: The present study aimed to identify factors related to SWL in 95 veterans of Operation Enduring Freedom (OEF), Operation Iraqi Freedom (OIF), and Operation New Dawn (OND) with a history of mild TBI. RESULTS: Regression analyses indicated that headache impact, pain interference, sleep quality, posttraumatic stress symptom severity, and social support were all significantly related to SWL. However, when secondary analyses were conducted including posttraumatic stress symptom severity as a covariate before the entry of other predictors, only sleep quality and social support remained significantly associated with SWL. CONCLUSIONS/IMPLICATIONS: These results indicate the importance of properly identifying and treating symptoms of posttraumatic stress in veterans with a history of mTBI, as posttraumatic stress symptoms appear to be strongly related to SWL in those with a history of mild TBI. Optimizing sleep quality and social support may also be important in improving SWL.

A Factor Analytic Approach to the Validation of the Word Memory Test and Test of Memory Malingering as Measures of Effort and Not Memory.

Research has demonstrated the utility of performance validity tests (PVTs) as a method of determining adequate effort during a neuropsychological evaluation. Although some studies affirm that forced-choice PVTs measure effort rather than memory, doubts remain in the literature. The purpose of the current study was to evaluate the relationship between effort and memory variables in a mild traumatic brain injury (TBI) sample (n = 160) by separating memory and effort as distinct factors while statistically controlling for the shared covariance between the variables. A two-factor solution was extracted such that the five PVT variables loaded on Factor 1 and the four memory variables loaded on Factor 2. The pattern matrix, which controls for the covariance between variables, provided clear support of two highly distinct factors with minimal cross-loadings. Our findings support assertions that PVTs measure effort independent of memory in veterans with mild TBI.

Clinician versus Veteran ratings on the Mayo-Portland Participation Index in veterans with a history of mild traumatic brain injury.

BACKGROUND: The Department of Veterans Affairs is encouraging administration of the Mayo-Portland Adaptability Inventory-4 Participation Index (M2PI) to identify long-term psychosocial outcomes of Operation Enduring Freedom (OEF), Operation Iraqi Freedom (OIF), and Operation New Dawn (OND) Veterans with a history of traumatic brain injury (TBI). OBJECTIVE: To evaluate clinician and Veteran interrater reliability and how response validity influences M2PI item ratings. PARTICIPANTS: A total of 122 OEF/OIF/OND Veterans who reported a history consistent with mild TBI during deployment and were referred for neuropsychological evaluation following Comprehensive TBI Evaluation. DESIGN: Interrater reliability study. MAIN MEASURES: M2PI; Minnesota Multiphasic Personality Inventory-2 Symptom Validity Scale (FBS). RESULTS: Veterans reported greater perceived restrictions than clinicians across all M2PI items and total score. Interrater correlations ranged from rs = 0.27 (residence) to rs = 0.58 (money management) across items, with a total score correlation of rs = 0.60. When response bias was indicated, both Veterans and clinicians reported greater participation restrictions than those reported by Veterans without evidenced response bias. CONCLUSION: Low interrater correlation is consistent with previous findings. As ratings of clinicians and Veterans should not be interpreted as equivalent, documenting the rater's identity is important for interpretation. Using objective indicators of functional outcome may assist clinician raters, particularly when self-report may be biased.

The dangers of failing one or more performance validity tests in individuals claiming mild traumatic brain injury-related postconcussive symptoms.

Evaluating performance validity is important in any neuropsychological assessment, and prior research recommends a threshold for invalid performance of two or more performance validity test (PVT) failures. However, extant findings also indicate that failing a single PVT is associated with significant changes in neuropsychological performance. The current study sought to determine if there is an appreciable difference in neuropsychological testing results between individuals failing different numbers of PVTs. In a sample of veterans with reported histories of mild traumatic brain injury (mTBI; N =178), analyses revealed that individuals failing only one PVT performed significantly worse than individuals failing no PVTs on measures of verbal learning and memory, processing speed, and cognitive flexibility. Additionally, individuals failing one versus two PVTs significantly differed only on delayed free recall scores. The current findings suggest that failure of even one PVT should elicit consideration of performance invalidity, particularly in individuals with histories of mTBI.

Ecological validity of performance validity testing.

Performance validity tests (PVTs) have been shown to relate to neuropsychological performance, but no studies have looked at the ecological validity of these measures. Data from 131 veterans with a history of mild traumatic brain injury from a multicenter Veterans Administration consortium were examined to determine the relation between scores on a self-report version of the Mayo-Portland Adaptability Inventory Participation Index, a measure of community participation, and the Word Memory Test, a PVT. A restricted regression model, including education, age, history of loss of consciousness, cognitive measures, and a measure of symptom validity test performance, was not significantly associated with self-reported community reintegration. Adding PVT results to the restricted model, however, did significantly improve the prediction of community reintegration as PVT failure was associated with lower self-reported community participation. The results of this study indicate that PVTs may also serve as an indicator of patients' functioning in the community.

PTSD and cognitive functioning: importance of including performance validity testing.

Many studies have observed an association between post-traumatic stress disorder (PTSD) and cognitive deficits across several domains including memory, attention, and executive functioning. The inclusion of response bias measures in these studies, however, remains largely unaddressed. The purpose of this study was to identify possible cognitive impairments correlated with PTSD in returning OEF/OIF/OND veterans after excluding individuals failing a well-validated performance validity test. Participants included 126 men and 8 women with a history of mild traumatic brain injury (TBI) referred for a comprehensive neuropsychological evaluation as part of a consortium of five Veterans Affairs hospitals. The PTSD CheckList (PCL) and Word Memory Test (WMT) were used to establish symptoms of PTSD and invalid performance, respectively. Groups were categorized as follows: Control (PCL < 50, pass WMT), PTSD-pass (PCL ≥ 50, pass WMT), and PTSD-fail (PCL ≥ 50, fail WMT). As hypothesized, failure on the WMT was associated with significantly poorer performance on almost all cognitive tests administered; however, no significant differences were detected between individuals with and without PTSD symptoms after separating out veterans failing the WMT. These findings highlight the importance of assessing respondent validity in future research examining cognitive functioning in psychiatric illness and warrant further consideration of prior studies reporting PTSD-associated cognitive deficits.

Heterogeneity in Trail Making Test performance in OEF/OIF/OND veterans with mild traumatic brain injury.

This study used cluster analysis to examine variability in Trail Making Test (TMT) performance in a sample of Operation Enduring Freedom/Operation Iraqi Freedom/Operation New Dawn (OEF/OIF/OND) veterans referred for mild traumatic brain injury (mTBI). Three clusters were extracted, two of which were characterized by level of performance and the third with a unique performance pattern characterized by slow performance on the TMT B (Low B). Clusters did not differ on demographic or psychiatric variables. The Above Average cluster had better performance on measures of processing speed, working memory, and phonemic fluency compared with the Low B cluster. Results suggest that a subset of patients with mTBI perform poorly on TMT B, which subsequently predicts poorer cognitive functioning on several other neuropsychological measures. This subset may be vulnerable to cognitive changes in the context of mTBI and multiple comorbidities while a number of other patients remain cognitively unaffected under the same circumstances.

Self-report of psychological function among OEF/OIF personnel who also report combat-related concussion.

MMPI-2 RF profiles of 128 U.S. soldiers and veterans with history of concussion were examined. Participants evaluated in forensic (n = 42) and clinical (n = 43) settings showed significantly higher validity and clinical elevations relative to a research group (n = 43). In the full sample, a multivariate GLM identified main effects for disability claim status and Axis I diagnosis across numerous MMPI-2 RF scales. Participants with co-morbid PTSD and concussion showed significant Restructured Clinical and Specific Problem scale elevations relative to those without Axis I diagnosis. Participants with PTSD and active disability claims were especially prone to elevate on FBS/FBS-r and RBS. Implications for neuropsychologists who routinely administer the MMPI-2/RF in the context of combat-related concussion are discussed.

Prolonged recovery of memory functioning after mild traumatic brain injury in adolescent athletes.

OBJECT: The current body of sports-related concussion literature is hampered by a lack of research conducted in high school athletes. Accordingly, the authors sought to examine the neuropsychological deficits and recovery patterns after concussive injuries in this population. METHODS: Participants included 419 male and female athletes with a mean age of 15.69 years who underwent baseline testing of their neuropsychological functioning prior to their sports season. Fourteen participants sustained an in-season concussion and were serially reassessed at ~2.5, 6, and 10 days postinjury. Fourteen uninjured matched control participants were also reassessed at the end of the school year. RESULTS: Individuals who sustained in-season concussions demonstrated impairments in reaction time, processing speed, and had delayed memory functioning. Although reaction time and processing speed deficits returned to baseline levels by ~6 days postinjury, participants continued to show memory impairments up to 7 days postinjury. Memory impairments were found to resolve by Day 10, however. CONCLUSIONS: The results of the present study suggest that high school athletes demonstrate prolonged memory dysfunction compared with college athletes, and should therefore be treated more conservatively.