Development of a measure for assessing malingered incompetency in criminal proceedings: Denney competency related test (D-CRT).

INTRODUCTION: Experts frequently assess competency in criminal settings where the rate of feigning cognitive deficit is demonstrably elevated. We describe the construction and validation of the Denney Competency Related Test (D-CRT) to assess feigned incompetency of defendants in the criminal adjudicative setting. It was expected the D-CRT would prove effective at identifying feigned incompetence based on its two alternative, forced-choice and performance curve characteristics. METHOD: Development and validation of the D-CRT occurred in described phases. Items were developed to measure competency based upon expert review. Item analysis and adjustments were completed with 304 young teenage volunteers to obtain a proper spread of item difficulty in preparation for eventual performance curve analysis (PCA). Test-retest reliability was assessed with 44 adult community volunteers. Validation included an analog simulation design with 101 jail detainees using MacArthur Competency Assessment Test-Criminal Adjudication and Word Memory Test as criterion measures. Effects of racial/ethnic demographic differences were examined in a separate study of 208 undergraduate volunteers. D-CRT specificity was identified with 46 elderly clinic referrals diagnosed with mild cognitive impairment and dementia. RESULTS: Item development, adjustment, and repeat analysis resulted in item probabilities evenly spread from .28 to 1.0. Test-retest correlation was good (.83). Internal consistency of items was excellent (KR-20 > .91). D-CRT demonstrated convergent validity in regard to measuring competency related information and as well as malingering. The test successfully differentiated between jail inmates asked to perforfm their best and inmates asked to simulate incompetency (AUC = .945). There were no statistically significant differences found in performance across racial/ethnic backgrounds. D-CRT specificity remained excellent among elderly clinic referrals with significant cognitive compromise at the recommended total score cutoff. CONCLUSIONS: D-CRT is an effective measure of feigned criminal incompetency in the context of potential cognitive deficiency, and PCA is assistive in the determination. Additional validation using knowns groups designs with various mental health-related conditions are needed.

Forensic neuropsychology: History and current status.

Objective:This review provides a summary of historical details and current practice activities related to Forensic Neuropsychology (FN). Under the auspices of the American Board of Clinical Neuropsychology (ABCN), the Forensic Neuropsychology Special Interest Group (FNSIG) views the FN as a subspecialty, which has developed over time as the straightforward result of more than 20 years of numerous publications, extensive continuing education, focused research and growth of forensic practice within neuropsychology. In this article, the FNSIG core work group documents and integrates information that is the basis of efforts to consolidate practice knowledge and facilitate attainment of forensic practice competencies by clinical neuropsychologists. Method:Overview of continuing education topics at professional conferences, search results that identify relevant books and peer-reviewed publications, as well as pertinent findings across years of large-scale national survey results. Results:Relevant evidence has shown for decades that FN is prominent within Clinical Neuropsychology as practiced in the United States and Canada. A majority of U.S. neuropsychologists have received FN training and provide forensic evaluation services. FN practice time per week is considerable for many practitioners, and across survey epochs has been shown to be increasing. Conclusion:The present review leads to the conclusion that in the interest of promoting the acquisition of competence, FN practice should remain a focal point of training and continuing education. Alternate routes to attain competence are discussed, as are ongoing professional activities that undoubtedly will ensure continued growth of, and interest in, the subspecialty of FN.

Official position of the American Academy of Clinical Neuropsychology on test security.

To provide education regarding the critical importance of test security for neuropsychological and psychological tests, and to establish recommendations for best practices for maintaining test security in forensic, clinical, teaching, and research settings. Previous test security guidelines were not adequately specified. METHOD: Neuropsychologists practicing in a broad range of settings collaborated to develop detailed and specific guidance regarding test security to best ensure continued viability of neuropsychological and psychological tests. Implications of failing to maintain test security for both the practice of neuropsychology and for society at large were identified. Types of test data that can be safely disclosed to nonpsychologists are described.Specific procedures can be followed that will minimize risk of invalidating future use of neuropsychological and psychological measures.Clinical neuropsychologists must commit to protecting sensitive neuropsychological and psychological test information from exposure to nonpsychologists, and now have specific recommendations that will guide that endeavor.

Integrative Care Models in Neuropsychology: A National Academy of Neuropsychology Education Paper.

Although collaborative, and more specifically, integrated models of care have existed for years, the 2010 Patient Protection and Affordable Care Act expanded their use, and Medicare has adopted a value-based payment system that further emphasizes service provision within the collaborative health care setting. Neuropsychology as a field is well-situated to work within the integrated health care setting, which presents both opportunities and challenges for clinical neuropsychologists. This education paper details how different neuropsychology clinical practice settings fit into an integrated care framework; discusses challenges to service delivery and fiscal viability in such settings and other health care related settings; and examines future directions for the role of neuropsychology within a dynamic health care system.

Population Health Solutions for Assessing Cognitive Impairment in Geriatric Patients.

In December 2017, the National Academy of Neuropsychology convened an interorganizational Summit on Population Health Solutions for Assessing Cognitive Impairment in Geriatric Patients in Denver, Colorado. The Summit brought together representatives of a broad range of stakeholders invested in the care of older adults to focus on the topic of cognitive health and aging. Summit participants specifically examined questions of who should be screened for cognitive impairment and how they should be screened in medical settings. This is important in the context of an acute illness given that the presence of cognitive impairment can have significant implications for care and for the management of concomitant diseases as well as pose a major risk factor for dementia. Participants arrived at general principles to guide future screening approaches in medical populations and identified knowledge gaps to direct future research. Key learning points of the summit included: recognizing the importance of educating patients and healthcare providers about the value of assessing current and baseline cognition;emphasizing that any screening tool must be appropriately normalized and validated in the population in which it is used to obtain accurate information, including considerations of language, cultural factors, and education; andrecognizing the great potential, with appropriate caveats, of electronic health records to augment cognitive screening and tracking of changes in cognitive health over time.

Population Health Solutions for Assessing Cognitive Impairment in Geriatric Patients.

In December 2017, the National Academy of Neuropsychology convened an interorganizational Summit on Population Health Solutions for Assessing Cognitive Impairment in Geriatric Patients in Denver, Colorado. The Summit brought together representatives of a broad range of stakeholders invested in the care of older adults to focus on the topic of cognitive health and aging. Summit participants specifically examined questions of who should be screened for cognitive impairment and how they should be screened in medical settings. This is important in the context of an acute illness given that the presence of cognitive impairment can have significant implications for care and for the management of concomitant diseases as well as pose a major risk factor for dementia. Participants arrived at general principles to guide future screening approaches in medical populations and identified knowledge gaps to direct future research. Key learning points of the summit included: recognizing the importance of educating patients and healthcare providers about the value of assessing current and baseline cognition; emphasizing that any screening tool must be appropriately normalized and validated in the population in which it is used to obtain accurate information, including considerations of language, cultural factors, and education; and recognizing the great potential, with appropriate caveats, of electronic health records to augment cognitive screening and tracking of changes in cognitive health over time.

Comparison of Performance of the VIP and WMT in a Criminal Forensic Sample.

OBJECTIVE: To compare the efficacy of the Validity Indicator Profile (VIP) and Word Memory Test (WMT) in a criminal forensic population. METHOD: Potential participants included 225 male evaluees from a maximum-security Federal prison referred for neuropsychological evaluation for either forensic purposes or for suspected neurocognitive dysfunction as part of a medical evaluation. Examinees were included in the analysis if administered the VIP (Verbal, Nonverbal, or both tests) and WMT along with at least two other freestanding PVTs; 74 satisfied these criteria. Participants were then categorized as having probable Malingered Neurocognitive Dysfunction (+MND) if they failed at least two freestanding validity indicators, negative for MND (-MND) if they passed all indicators, and Possible MND (pMND) if they failed one indicator. RESULTS: Groups were very demographically similar. There were significant differences in WMT scores and distribution of VIP profiles across groups. Whether using traditional or investigative cut scores, and whether using the WMT with or without consideration of a GMIP profile, the WMT demonstrated superior sensitivity and specificity on nearly every comparison. CONCLUSIONS: The VIP, when interpreted in the traditional fashion, and the WMT with GMIP, both had more than adequate psychometric properties when used with criminal forensic evaluees, strengthening the body of literature supporting their use for these types of evaluations. Counting a positive on either of the VIP subtests as an indication of +MND improves the psychometric properties of the VIP slightly, although the WMT had the better overall classification accuracy.

Effects of handcuffs on neuropsychological testing: Implications for criminal forensic evaluations.

Neuropsychological evaluations are increasingly performed in forensic contexts, including in criminal settings where security sometimes cannot be compromised to facilitate evaluation according to standardized procedures. Interpretation of nonstandardized assessment results poses significant challenges for the neuropsychologist. Research is limited in regard to the validation of neuropsychological test accommodation and modification practices that deviate from standard test administration; there is no published research regarding the effects of hand restraints upon neuropsychological evaluation results. This study provides preliminary results regarding the impact of restraints on motor functioning and common neuropsychological tests with a motor component. When restrained, performance on nearly all tests utilized was significantly impacted, including Trail Making Test A/B, a coding test, and several tests of motor functioning. Significant performance decline was observed in both raw scores and normative scores. Regression models are also provided in order to help forensic neuropsychologists adjust for the effect of hand restraints on raw scores of these tests, as the hand restraints also resulted in significant differences in normative scores; in the most striking case there was nearly a full standard deviation of discrepancy.

Sandbagging on the Immediate Post-Concussion Assessment and Cognitive Testing (ImPACT) in a high school athlete population.

The Immediate Post-Concussion Assessment and Cognitive Testing (ImPACT) is a computerized neuropsychological test battery commonly used to assess cognitive functioning after a concussion. It is recommended that application of ImPACT utilizes a baseline administration so athletes have an individualized baseline with which to compare post-injury results should they sustain a concussion. It has been suggested that athletes may provide suboptimal effort, called "sandbagging," in order to return to their baseline cognitive scores, and thus to play, more quickly. This research examines ImPACT baseline scores when high school athletes were asked to attempt to "sandbag," and compares those scores with scores obtained when they were asked to give their "best effort." Fifty-four high school student athlete volunteers participated in the study. In contrast to previous research that just looked at the cut-score invalidity indicators built into ImPACT, this research developed a regression equation to predict sandbagging. A logistic regression equation developed with four variables that demonstrated the largest effect size between "best effort" and "sandbagged" baselines showed a 99.7% classification accuracy for the "best effort" and "sandbag" groups.

Cognitive Screening Tests Versus Comprehensive Neuropsychological Test Batteries: A National Academy of Neuropsychology Education Paper†.

The American Medical Association Current Procedural Panel developed a new billing code making behavioral health screening a reimbursable healthcare service. The use of computerized testing as a means for cognitive screening and brief cognitive testing is increasing at a rapid rate. The purpose of this education paper is to provide information to clinicians, healthcare administrators, and policy developers about the purpose, strengths, and limitations of cognitive screening tests versus comprehensive neuropsychological evaluations. Screening tests are generally brief and narrow in scope, they can be administered during a routine clinical visit, and they can be helpful for identifying individuals in need of more comprehensive assessment. Some screening tests can also be helpful for monitoring treatment outcomes. Comprehensive neuropsychological assessments are multidimensional in nature and used for purposes such as identifying primary and secondary diagnoses, determining the nature  and severity of a person's cognitive difficulties, determining functional limitations, and planning treatment and rehabilitation. Cognitive screening tests are expected to play an increasingly important role in identifying individuals with cognitive impairment and in determining which individuals should be referred for further neuropsychological assessment. However, limitations of existing cognitive screening tests are present and cognitive screening tests should not be used as a replacement for comprehensive neuropsychological testing.

TOMM Trial 1 as a performance validity indicator in a criminal forensic sample.

OBJECTIVE: To determine the effectiveness of the Test of Memory Malingering Trial 1 (TOMM1) as a freestanding Performance Validity Test (PVT) as compared to the full TOMM in a criminal forensic sample. METHOD: Participants included 119 evaluees in a Midwestern forensic hospital. Criterion groups were formed based on passing/failing scores on other freestanding PVTs. This resulted in three groups: +MND (Malingered Neurocognitive Dysfunction), who failed two or more freestanding PVTs; possible MND (pMND), who failed one freestanding PVT; and -MND, who failed no other freestanding PVTs. All three groups were compared initially, but only +MND and -MND groups were retained for final analyses. TOMM1 performance was compared to standard TOMM performance using Receiver Operating Characteristic (ROC) analyses. RESULTS: TOMM1 was highly predictive of the standard TOMM decision rules (AUC = .92). Overall accuracy rate for TOMM1 predicting failure on 2 PVTs was quite robust as well (AUC = .80), and TOMM1 ≤ 39 provided acceptable diagnostic statistics (Sensitivity = .68, Specificity = .89). These results were essentially no different from the standard TOMM accuracy statistics. In addition, by adjusting for those strongly suspected of being inaccurately placed into the -MND group (e.g. false negatives), TOMM1 diagnostics slightly improved (AUC = .84) at a TOMM1 ≤ 40 (sensitivity = .71, specificity = .94). CONCLUSIONS: Results support use of TOMM1 in a criminal forensic setting where accuracy, shorter evaluation times, and more efficient use of resources are often critical in informing legal decision-making.

Development of the Poor Validity Profile Analysis for the Medical Symptom Validity Test.

OBJECTIVES: The Medical Symptom Validity Test (MSVT) offers a profile analysis for performance validity, but individuals performing with suboptimal performance validity are frequently misidentified by current profile rules. The aim of this study was to develop and validate a new profile analysis for the MSVT. METHOD: This study utilized 2 phases to investigate current profile analyses and construct a new analysis. Phase I compared graduate students and adult volunteers asked to simulate dementia to individuals with dementia in long-term care facilities. Phase I included development of a logistic equation with a logit model correction and introduced 4 new profiles. Phase II investigated the 4 proposed profiles using a new sample of graduate students asked to simulate dementia and outpatient dementia referrals. RESULTS: The 4 proposed profiles showed high specificity (94%-96%) and acceptable sensitivity (79.5%-95.5%) in Phase I. In Phase II, 1 profile out performed others by demonstrating 95.7% specificity and 86% sensitivity. High sensitivity (84%) and specificity (96%) were obtained for aggregate samples using this profile. CONCLUSIONS: This research provides an alternative profile analysis for the MSVT that outperforms the available analysis in identifying poor performance validity from genuine impairment.

Comparison of performance of the test of memory malingering and word memory test in a criminal forensic sample.

Compared with the amount of neuropsychological literature surrounding response bias in civil litigation, there is little regarding criminal cases. This study adds to the criminal forensic neuropsychological literature by comparing the Test of Memory Malingering (TOMM) and the Word Memory Test (WMT) in a criminal forensic setting utilizing a criterion-groups design. Subjects were classified into two groups based on their performance on at least two other freestanding performance validity tests. The WMT demonstrated good sensitivity (95.1%) but poor specificity (68.4%) when Genuine Memory Impaired Profiles (GMIPs) were not considered. Inclusion of GMIPs reduced the sensitivity to 56.1% but increased the specificity to 94.7%. The TOMM evidenced better sensitivity but poorer specificity than the WMT with GMIPs. Conjoint use of the tests was also considered. Receiver operating characteristics and other classification statistics for each measure are presented. Results support the use of these measures in a criminal forensic population.

The detection of feigned impairment using the WMT, MSVT, and NV-MSVT.

The current study sought to evaluate the sensitivity of the Word Memory Test, Medical Symptom Validity Test, and the Nonverbal Medical Symptom Validity Test (NV-MSVT) in a group of 50 well-educated individuals asked to simulate dementia. With use of the Genuine Memory Impairment Profile as operationalized by the Advanced Interpretation Program, sensitivities for single measures and the measures in combination ranged from 54% to 98% in the detection of suboptimal effort. Overall, the NV-MSVT appeared the most sensitive to feigned memory impairment in this sample.

Comparison of the repeatable battery for the assessment of neuropsychological status effort scale and effort index in a dementia sample.

The aim of the current study was to compare two embedded measures of effort for the repeatable battery for the assessment of neuropsychological status (RBANS). Sensitivity and specificity of the Effort Index (EI) and Effort Scale (ES) were compared in a sample of individuals with genuine memory impairment (MI) and individuals coached to simulate MI. Overall, the EI yielded a sensitivity of 0.89 and specificity of 0.41, while the ES yielded a sensitivity of 0.88 and specificity of 0.81. When those in the MI group were separated by level of impairment, the EI was more specific when RBANS Total Scores were in the average or mildly impaired range, and the ES had greater specificity when RBANS Total Scores were in the severely impaired range. These results suggest that the embedded measure should be selected based on the level of impairment on the RBANS.

Limited predictive accuracy of the Booklet Category Test in a criminal forensic sample.

A known-groups design was used to evaluate the clinical decision rules of the validity indicators of the Booklet Category Test for the detection of malingered neurocognitive dysfunction (MND) in an incarcerated male sample. Participants were 128 inmates who were classified into MND and presumed valid groups using the Slick, Sherman, and Iverson ( 1999 ) criteria. While errors on Subtests I and II had the best classification accuracy at 71.1% with 95.1% specificity and 49.3% sensitivity, the associated area under the curve (AUC) indicated only "acceptable" discrimination due to poor sensitivity. Logistic regression confirmed that errors on Subtests I and II were the only statistically significant validity indicator. The remaining validity indicators performed poorly with AUCs at < .70, indicating no discriminative power. The effectiveness of the clinical decision rules of the validity indicators in predicting the presence of MND evidenced limited support. A positive finding on Subtest I and II errors was clinically significant in this sample, but negative results revealed no utility. Validity indices composed from different items may yield more effective results among male prisoners referred for neuropsychological evaluation.

An Improved Measure of Handedness: The Fazio Laterality Inventory.

The Edinburgh Handedness Inventory (EHI) is the most widely used handedness inventory. The EHI has some weaknesses: it has been suggested it is outdated; the instructions are frequently misunderstood by participants; and the response format produces skewed responses in those who avoid extreme responding. This study introduces the Fazio Laterality Inventory (FLI) as an alternative that addresses these limitations. In an initial development study, the 12-item instrument showed acceptable internal reliability (Cronbach's alpha =.921), and a one-component solution explained 55.5% of the variance. After removal of two items, a validation study revealed the instrument again had good internal reliability (Cronbach's alpha =.943) with a one-component solution explaining 65.8% of the variance. The FLI did not correlate as strongly as expected with the EHI, likely due to its lack of an "Oldfield Admonition" as well as the finer scaling of the response format. Additional analyses of the FLI as a whole and each item are offered. A scoring procedure and cutoffs for utilizing the FLI in clinical and research settings are suggested.

Neurocognitive deficits associated with the hepatitis C virus among incarcerated men.

The purpose of this preliminary study was to examine cognitive functioning in inmates with the hepatitis C virus (HCV) and to investigate relationships among performance on the Repeatable Battery for the Assessment of Neuropsychological Status-Form A (RBANS; Randolph, 1998). Data from 43 HCV+ inmates were reviewed retrospectively and compared with a sample of HCV- inmates. Significant differences were found on two of five indices (Attention: U = 537.5, p = .003; r = -.32; Total: U = 643.0, p = .048; r = -.22) and four subtests: Coding (U = 326.0, p <.001, r = -.53), Digit Span (U = 634.0, p = .038, r = -.22), Story Memory (U = 625.5, p = .032, r = -.24), and Story Recall (U = 548.5, p = .004, r = -.31), with the HCV group scoring lower on all significant measures. In this study the RBANS proved to be an efficient measure with clinical utility among an HCV population. Within this incarcerated population patterns of performance were "typical" of current literature, with impaired attention appearing earlier in the disease process, and the study invites further exploration into proposed cognitive deficits among this population where HCV is highly prevalent.