Return on Investment and Value Research in Neuropsychology: A Call to Arms†.

There is substantial empirical evidence to support the clinical value of neuropsychological evaluation and the incremental value of neuropsychological assessment, suggesting such evaluation is beneficial in the prediction and management of clinical outcomes. However, in the cost-conscious and evolving era of healthcare reform, neuropsychologists must also establish the economic value, or return on investment, of their services. There is already a modest body of literature that demonstrates the economic benefits of neuropsychological evaluation, which is reviewed in the current paper. Neuropsychologists will need to be able to communicate, and develop evidence of, economic value of their services; thus, this paper also discusses common concepts, terms, and models used in healthcare valuation studies. Finally, neuropsychologists are urged to incorporate these financial concepts in their clinical practice and research.

Integrative Care Models in Neuropsychology: A National Academy of Neuropsychology Education Paper.

Although collaborative, and more specifically, integrated models of care have existed for years, the 2010 Patient Protection and Affordable Care Act expanded their use, and Medicare has adopted a value-based payment system that further emphasizes service provision within the collaborative health care setting. Neuropsychology as a field is well-situated to work within the integrated health care setting, which presents both opportunities and challenges for clinical neuropsychologists. This education paper details how different neuropsychology clinical practice settings fit into an integrated care framework; discusses challenges to service delivery and fiscal viability in such settings and other health care related settings; and examines future directions for the role of neuropsychology within a dynamic health care system.

Validation of ANAM for cognitive screening in a mixed clinical sample.

The Automated Neuropsychological Assessment Metrics (ANAM) is a library of computer based tests designed to measure cognitive function at a single time-point or longitudinally for detection of cognitive change. This study sought to validate ANAM as a cognitive screening tool for presence of confirmed neuropsychological diagnosis in an outpatient setting. Retrospective data analysis was conducted for 139 patients referred for outpatient neuropsychological assessment. Clinical diagnosis was made independent of ANAM test results and resulted in a diagnostic mix of both neurologic and psychologic etiologies. ANAM scores predictive of presence of confirmed diagnosis were identified using multiple logistic regression and the predictive ability of the resulting model was quantified using receiver operator characteristic analysis. Sensitivity and specificity for the ANAM when combined with anger and depressive symptom scores were 71% and 91%, respectively, with a positive predictive value of 97.5 and negative predictive value of 40.4. This combined approach provided the greatest accuracy for individual tests as well as the composite score of the ANAM in identifying those who received a subsequent clinical diagnosis. Although data should be replicated in larger samples, these results suggest that ANAM may have predictive value and may be a useful screening tool for identifying those who would likely benefit from neuropsychological services.

Test-retest reliability and practice effects for the ANAM General Neuropsychological Screening battery.

OBJECTIVE: As the use of computer-based neurocognitive assessment is rapidly expanding, the need to systematically study and document key psychometric properties of these measures has become increasingly more salient. To meet this aim, this study examined test-retest reliability and practice effects for the Automated Neuropsychological Assessment Metrics General Neuropsychological Screening battery (ANAM GNS) in a sample of 94 community dwelling adults. METHOD: ANAM GNS was administered and then repeated (alternate form) after 30 days. Test-retest reliability, practice effects, and the standard error of measurement were calculated. Using these estimates, reliable change indices were calculated to determine degree of performance change needed to exceed chance and measurement error (with 90% confidence interval). RESULTS: The test-retest reliability for the ANAM composite score was .91. Performance significantly improved upon retest, but the effect size was small consistent with minimal practice effects. The threshold indicating change beyond chance or measurement error with 90% certainty was .9 (z-score). CONCLUSIONS: Findings suggest that the ANAM GNS has excellent test-retest reliability upon retest at 30 days. Small practice effects can be expected. Change greater than .9 standard deviations in the ANAM composite score is likely to represent meaningful clinical change. This paper presents initial psychometric data from the ANAM GNS and supports its use as a reliable measure of cognition.

Classification accuracy of the Minnesota Multiphasic Personality Inventory-2 (MMPI-2)-Restructured form validity scales in detecting malingered pain-related disability.

The symptom reports of individuals with chronic pain are multidimensional (e.g., emotional, cognitive, and somatic) and significantly contribute to increased morbidity and lost work productivity. When pain occurs in the context of a legally compensable event, reliable assessment of a patient's multifactorial symptom experience during psychological or neuropsychological evaluations is a necessity. The Validity Scales of the Minnesota Multiphasic Personality Inventory-2 (MMPI-2) have been shown useful in identifying symptom overreporting and feigning within chronic pain samples and a number of studies have emerged supporting the use of the MMPI-2-Restructured Form (MMPI-2-RF) in the detection of simulated or feigned impairment in a variety of populations. To date, only 1 other study exists examining the ability of the MMPI-2-RF to detect exaggerated complaints using a strict operationalization of malingering exclusive to chronic pain samples. The purpose of this study was to examine the classification accuracy of MMPI-2-RF Validity Scales in a group of patients with chronic pain using a criterion-groups design. The final sample consisted of 501 clinical chronic pain patients assigned to groups based on the Bianchini, Greve, and Glynn (2005) criteria for Malingered Pain-Related Disability (MPRD). Results showed that all MMPI-2-RF Validity Scales differentiated malingerers from nonmalingerers with a high degree of accuracy. At cut-offs associated with ≥95% Specificity, Sensitivities ranged from 15% (Fs) to 60% (Response Bias Scale; RBS). This study demonstrates that the MMPI-2-RF Validity Scales are capable of differentiating intentional symptom exaggeration from genuine complaints in a sample of incentivized chronic pain patients. (PsycINFO Database Record

Cognitive Screening Tests Versus Comprehensive Neuropsychological Test Batteries: A National Academy of Neuropsychology Education Paper†.

The American Medical Association Current Procedural Panel developed a new billing code making behavioral health screening a reimbursable healthcare service. The use of computerized testing as a means for cognitive screening and brief cognitive testing is increasing at a rapid rate. The purpose of this education paper is to provide information to clinicians, healthcare administrators, and policy developers about the purpose, strengths, and limitations of cognitive screening tests versus comprehensive neuropsychological evaluations. Screening tests are generally brief and narrow in scope, they can be administered during a routine clinical visit, and they can be helpful for identifying individuals in need of more comprehensive assessment. Some screening tests can also be helpful for monitoring treatment outcomes. Comprehensive neuropsychological assessments are multidimensional in nature and used for purposes such as identifying primary and secondary diagnoses, determining the nature  and severity of a person's cognitive difficulties, determining functional limitations, and planning treatment and rehabilitation. Cognitive screening tests are expected to play an increasingly important role in identifying individuals with cognitive impairment and in determining which individuals should be referred for further neuropsychological assessment. However, limitations of existing cognitive screening tests are present and cognitive screening tests should not be used as a replacement for comprehensive neuropsychological testing.

Cognitive changes and dementia risk after traumatic brain injury: implications for aging military personnel.

Traumatic brain injury (TBI) is recognized as an important risk factor for the long-term cognitive health of military personnel, particularly in light of growing evidence that TBI increases risk for Alzheimer's disease and other dementias. In this article, we review the neurocognitive and neuropathologic changes after TBI with particular focus on the potential risk for cognitive decline across the life span in military service members. Implications for monitoring and surveillance of cognition in the aging military population are discussed. Additional studies are needed to clarify the factors that increase risk for later life cognitive decline, define the mechanistic link between these factors and dementia, and provide empirically supported interventions to mitigate the impact of TBI on cognition across the life span.

Initial clinical validation of an embedded performance validity measure within the automated neuropsychological metrics (ANAM).

The measurement of effort and performance validity is essential for computerized testing where less direct supervision is needed. The clinical validation of an Automated Neuropsychological Metrics-Performance Validity Index (ANAM-PVI) was examined by converting ANAM test scores into a common metric based on their relative infrequency in an outpatient clinic sample with presumed good effort. Optimal ANAM-PVI cut-points were determined using receiver operator characteristic (ROC) curve analyses and an a priori specificity of 90%. Sensitivity/specificity was examined in available validation samples (controls, simulators, and neurorehabilitation patients). ANAM-PVI scores differed between groups with simulators scoring the highest. ROC curve analysis indicated excellent discriminability of ANAM-PVI scores ≥5 to detect simulators versus controls (area under the curve = 0.858; odds ratio for detecting suboptimal performance = 15.6), but resulted in a 27% false-positive rate in the clinical sample. When specificity in the clinical sample was set at 90%, sensitivity decreased (68%), but was consistent with other embedded effort measures. Results support the ANAM-PVI as an embedded effort measure and demonstrate the value of sample-specific cut-points in groups with cognitive impairment. Examination of different cut-points indicates that clinicians should choose sample-specific cut-points based on sensitivity and specificity rates that are most appropriate for their patient population with higher cut-points for those expected to have severe cognitive impairment (e.g., dementia or severe acquired brain injury).

Evidence for added value of baseline testing in computer-based cognitive assessment.

CONTEXT: Large-scale baseline cognitive assessment for individuals at risk for concussion is a common part of the protocol for concussion-surveillance programs, particularly in sports. Baseline cognitive testing is also being conducted in US military service members before deployment. Recently, the incremental validity of large-scale baseline cognitive assessment has been questioned. OBJECTIVE: To examine the added value of baseline cognitive testing in computer-based neuropsychological assessment by comparing 2 methods of classifying atypical performance in a presumed healthy sample. DESIGN: Cross-sectional study. SETTING: Military base. PATIENTS OR OTHER PARTICIPANTS: Military service members who took the Automated Neuropsychological Assessment Matrix (ANAM) before and after deployment (n = 8002). MAIN OUTCOME MEASURE(S): Rates of atypical performance in this healthy, active-duty sample were determined first by comparing postdeployment scores with a military normative database and then with each individual's personal baseline performance using a reliable change index. RESULTS: Overall rates of atypical performance were comparable across these 2 methods. However, these methods were highly discordant in terms of which individuals were classified as atypical. When norm-referenced methods were used, 2.6% of individuals classified as normal actually demonstrated declines from baseline. Further, 65.7% of individuals classified as atypical using norm-referenced scores showed no change from baseline (ie, potential false-positive findings). CONCLUSIONS: Knowing an individual's baseline performance is important for minimizing potential false-positive errors and reducing the risks and stresses of misdiagnosis.

Cognitive change associated with self-reported mild traumatic brain injury sustained during the OEF/OIF conflicts.

Traumatic brain injury (TBI) has received much attention due to high rates of this injury in Service Members returning from the Iraq/Afghanistan conflicts. This study examined cognitive performance in Service Members tested with ANAM prior to and following deployment. The sample was divided into a control group (n=400) reporting no TBI injury prior to or during most recent deployment, and a group who self-reported a TBI injury (n=502) during most recent deployment. This latter group was divided further based on self-report of post-concussion symptoms at post-deployment testing. All three groups performed similarly at pre-deployment. The group reporting TBI with active symptoms performed worst at post-deployment and included the highest percentage of individuals showing significant decline in cognitive performance over time (30.5%). A small sample of symptomatic individuals with a non-TBI reported injury did not demonstrate similar declines in performance, suggesting that active symptoms alone cannot account for these findings. Of those reporting a TBI injury during deployment, 70% demonstrated no significant change in cognitive performance compared with baseline. Although the exact etiology of observed declines is uncertain, findings indicate that individuals who self-report TBI during deployment with active symptomatology at post-deployment are at greatest risk for declines in cognitive performance. These individuals can be identified using self-report and brief computer-based testing. Importantly, the majority of active-duty individuals reporting TBI during deployment do not present with lasting significant cognitive impairment, a finding consistent with the civilian literature on mild TBI.

Functional magnetic resonance imaging of working memory and response inhibition in children with mild traumatic brain injury.

The current pilot study examined functional magnetic resonance imaging (fMRI) activation in children with mild traumatic brain injury (mTBI) during tasks of working memory and inhibitory control, both of which are vulnerable to impairment following mTBI. Thirteen children with symptomatic mTBI and a group of controls completed a version of the Tasks of Executive Control (TEC) during fMRI scanning. Both groups showed greater prefrontal activation in response to increased working memory load. Activation patterns did not differ between groups on the working memory aspects of the task, but children with mTBI showed greater activation in the posterior cerebellum with the addition of a demand for inhibitory control. Children with mTBI showed greater impairment on symptom report and "real world" measures of executive functioning, but not on traditional "paper and pencil" tasks. Likewise, cognitive testing did not correlate significantly with imaging results, whereas increased report of post-concussive symptoms were correlated with increased cerebellar activation. Overall, results provide some evidence for the utility of symptom report as an indicator of recovery and the hypothesis that children with mTBI may experience disrupted neural circuitry during recovery. Limitations of the study included a small sample size, wide age range, and lack of in-scanner accuracy data.

Collaboration between neuropsychologists and speech-language pathologists in rehabilitation settings.

OBJECTIVE: The purpose of this study was to understand the barriers and facilitators of communication and collaboration between speech-language pathologists (SLPs) and neuropsychologists (NPs) in rehabilitation settings. METHOD: Focus groups were held at 3 rehabilitation hospitals. Participants were a convenience sample and were considered representatives of acquired brain injury rehabilitation teams that include SLPs and NPs. There were a total of 28 SLPs and 10 NPs in the sample. The study used a semistructured interview guide for the focus group discussions, using questions centered on major areas known to be related to interdisciplinary collaboration. Written notes and audio recordings were analyzed for recurring and strongly stated themes. RESULTS: Consistent themes emerged across focus groups, which included (1) structure of collaboration, (2) perceived roles of NPs and SLPs in assessment and intervention, (3) similarities and differences in training and philosophic perspectives, (4) barriers to successful collaboration, and (5) facilitators of collaboration. CONCLUSION: The SLPs and NPs valued the contributions of both professions in the management of patients with acquired brain injuries. Effective collaboration appeared to be influenced by several factors and is discussed. It was evident that effective communication was a key and powerful element in successful collaboration.

Children with heavy prenatal alcohol exposure demonstrate deficits on multiple measures of concept formation.

BACKGROUND: Children with heavy prenatal alcohol exposure have documented impairments in executive functioning (EF). One component of EF, concept formation, has not been well studied in this group. METHODS: Children (8 to 18 years) with histories of heavy prenatal alcohol exposure, with and without fetal alcohol syndrome (FAS), were compared to typically developing controls on 2 measures of concept formation and conceptual set shifting: the Wisconsin Card Sorting Test and the Card Sorting Test from the Delis-Kaplan Executive Functioning System. In addition to between-group comparisons, performance relative to overall intellectual functioning was examined. RESULTS: Children with histories of heavy prenatal alcohol exposure showed impairment on both tests of concept formation compared to non-exposed controls. These deficits included difficulty generating and verbalizing concepts, increased error rates and perseverative responses, and poorer response to feedback. However, in comparison to controls, alcohol-exposed children performed better on measures of concept formation than predicted by their overall IQ scores. Exploratory analyses suggest that this may be due to differences in how the measures relate at different IQ levels and may not be specific to prenatal alcohol exposure. CONCLUSIONS: Deficits in concept formation and conceptual set shifting were observed in alcohol-exposed children with or without the diagnosis of FAS and in the absence of mental retardation. These deficits likely impact problem solving skills and adaptive functioning and have implications for therapeutic interventions in this population.

Use of computerized assessment to predict neuropsychological functioning and emotional distress in patients with systemic lupus erythematosus.

OBJECTIVE: Cognitive dysfunction and neuropsychiatric disturbance are common in systemic lupus erythematosus (SLE). This study addressed the ability of the Automated Neuropsychological Assessment Metrics (ANAM), a computerized cognitive testing battery consisting of cognitive subtests, a sleepiness rating scale, and a mood scale, to predict neuropsychological status in patients with SLE. METHODS: Sixty individuals with SLE and no overt neuropsychiatric symptoms were administered ANAM to determine its validity as a screening measure of cognitive dysfunction and emotional distress in SLE. RESULTS: Performance on ANAM was compared with results of a consecutively administered, 2-hour battery of traditional neuropsychological tests and the Beck Depression Inventory II (BDI-II). Individual ANAM cognitive test scores were significantly correlated with most neuropsychological tests, particularly those measuring psychomotor processing speed and executive functioning. Using logistic regression, ANAM cognitive subtests successfully predicted individuals with SLE who had probable versus no impairment after controlling for premorbid levels of cognitive ability. Sensitivity of group classification was 76.2% and specificity was 82.8%, with 80% correct classification overall. ANAM's ability to predict neuropsychological functioning remained even after controlling for subjective reports of depressed mood and current sleepiness. Further, the ANAM mood scale was significantly correlated with the BDI-II (r = 0.67, P < 0.001), indicating its potential future use as a screening tool for emotional distress. CONCLUSION: ANAM shows promise as a time- and cost-efficient tool for screening and monitoring cognitive and emotional functioning in SLE, and can indicate when a more thorough neuropsychological investigation is warranted.

Implicit strategy affects learning in children with heavy prenatal alcohol exposure.

BACKGROUND: Learning and memory deficits are commonly reported in children with heavy prenatal alcohol exposure. Our recent work suggested that children with heavy prenatal alcohol exposure retained information as well as controls on a verbal learning test but not on a test of nonverbal learning and memory. To better understand the cause of this differential pattern of performance, the current study re-analyzed data from our previous study to determine if the presence of an implicit learning strategy may account, at least in part, for the finding of spared retention. METHODS: The current study examined verbal learning and memory abilities in 35 children with Fetal Alcohol Spectrum Disorders (FASD) and 34 nonexposed controls (CON) matched for age (9-16 years), sex, ethnicity, handedness, and socioeconomic status. Groups were compared on two measures of verbal learning, one with an implicit strategy (California Verbal Learning Test-Children's Version; CVLT-C) and one without (Verbal Learning subtest of the Wide Range Assessment of Memory and Learning; VL-WRAML). RESULTS: Children with FASD learned less information overall than children in the CON group. Both groups learned a greater percentage of information and reached a learning plateau earlier on the CVLT-C compared with the VL-WRAML. Groups also showed comparable rates of retention after a delay on the CVLT-C. In contrast, on the VL-WRAML, children with FASD showed poorer retention rates than children in the CON group. Interestingly, children with FASD did not differ from children in the CON group on CVLT-C semantic clustering scores for learning trials 1 through 3, and greater utilization of semantic clustering was correlated with better learning and memory performance in both groups. This overall pattern of results was not related to overall intellectual level. CONCLUSIONS: The finding of spared retention of verbal information on the CVLT-C in our earlier studies may be related to test characteristics of the CVLT-C rather than a finding of spared verbal retention per se, given that spared retention was not found on a separate test of verbal learning and memory without an implicit learning strategy. These results suggest that the use of an implicit strategy positively affected the ability of alcohol-exposed children to learn and retain new verbal information.

Bimanual coordination in alcohol-exposed children: role of the corpus callosum.

The corpus callosum (CC) is one of several brain structures affected in children prenatally exposed to alcohol. This structure plays a major role in coordinating motor activity from opposite sides of the body, and deficits in bimanual coordination have been documented in individuals with agenesis of or damage to the CC, particularly when the task is performed without visual feedback. The Bimanual Coordination Test was used to assess speed and accuracy on a task where both hands must coordinate to guide a cursor through angled pathways providing measures of interhemispheric interaction or the ability of the two hemispheres to coordinate activity via the corpus callosum. Twenty-one children with fetal alcohol spectrum disorders (FASD) and 17 non-exposed control children (CON), matched closely in age, sex, and ethnicity were tested. For trials with visual feedback (WV), children with FASD were slower than CON children but were equally accurate. Although statistically significant group differences were not observed on most trials completed without visual feedback (WOV), accuracy of the FASD group on WOV trials was highly variable. Group differences in accuracy on WOV angles approached significance after accounting for performance on the WV angles, and children with FASD were significantly less accurate on an individual angle believed to be particularly sensitive to interhemispheric interaction. These results indicate that children with FASD are slower than CON children but equally accurate on basic visuomotor tasks. However, as task complexity and reliance on interhemispheric interaction increases, children with FASD demonstrate variable and inaccurate performance.