Return on Investment and Value Research in Neuropsychology: A Call to Arms†.

There is substantial empirical evidence to support the clinical value of neuropsychological evaluation and the incremental value of neuropsychological assessment, suggesting such evaluation is beneficial in the prediction and management of clinical outcomes. However, in the cost-conscious and evolving era of healthcare reform, neuropsychologists must also establish the economic value, or return on investment, of their services. There is already a modest body of literature that demonstrates the economic benefits of neuropsychological evaluation, which is reviewed in the current paper. Neuropsychologists will need to be able to communicate, and develop evidence of, economic value of their services; thus, this paper also discusses common concepts, terms, and models used in healthcare valuation studies. Finally, neuropsychologists are urged to incorporate these financial concepts in their clinical practice and research.

Integrative Care Models in Neuropsychology: A National Academy of Neuropsychology Education Paper.

Although collaborative, and more specifically, integrated models of care have existed for years, the 2010 Patient Protection and Affordable Care Act expanded their use, and Medicare has adopted a value-based payment system that further emphasizes service provision within the collaborative health care setting. Neuropsychology as a field is well-situated to work within the integrated health care setting, which presents both opportunities and challenges for clinical neuropsychologists. This education paper details how different neuropsychology clinical practice settings fit into an integrated care framework; discusses challenges to service delivery and fiscal viability in such settings and other health care related settings; and examines future directions for the role of neuropsychology within a dynamic health care system.

Population Health Solutions for Assessing Cognitive Impairment in Geriatric Patients.

In December 2017, the National Academy of Neuropsychology convened an interorganizational Summit on Population Health Solutions for Assessing Cognitive Impairment in Geriatric Patients in Denver, Colorado. The Summit brought together representatives of a broad range of stakeholders invested in the care of older adults to focus on the topic of cognitive health and aging. Summit participants specifically examined questions of who should be screened for cognitive impairment and how they should be screened in medical settings. This is important in the context of an acute illness given that the presence of cognitive impairment can have significant implications for care and for the management of concomitant diseases as well as pose a major risk factor for dementia. Participants arrived at general principles to guide future screening approaches in medical populations and identified knowledge gaps to direct future research. Key learning points of the summit included: recognizing the importance of educating patients and healthcare providers about the value of assessing current and baseline cognition;emphasizing that any screening tool must be appropriately normalized and validated in the population in which it is used to obtain accurate information, including considerations of language, cultural factors, and education; andrecognizing the great potential, with appropriate caveats, of electronic health records to augment cognitive screening and tracking of changes in cognitive health over time.

Population Health Solutions for Assessing Cognitive Impairment in Geriatric Patients.

In December 2017, the National Academy of Neuropsychology convened an interorganizational Summit on Population Health Solutions for Assessing Cognitive Impairment in Geriatric Patients in Denver, Colorado. The Summit brought together representatives of a broad range of stakeholders invested in the care of older adults to focus on the topic of cognitive health and aging. Summit participants specifically examined questions of who should be screened for cognitive impairment and how they should be screened in medical settings. This is important in the context of an acute illness given that the presence of cognitive impairment can have significant implications for care and for the management of concomitant diseases as well as pose a major risk factor for dementia. Participants arrived at general principles to guide future screening approaches in medical populations and identified knowledge gaps to direct future research. Key learning points of the summit included: recognizing the importance of educating patients and healthcare providers about the value of assessing current and baseline cognition; emphasizing that any screening tool must be appropriately normalized and validated in the population in which it is used to obtain accurate information, including considerations of language, cultural factors, and education; and recognizing the great potential, with appropriate caveats, of electronic health records to augment cognitive screening and tracking of changes in cognitive health over time.

Validation of ANAM for cognitive screening in a mixed clinical sample.

The Automated Neuropsychological Assessment Metrics (ANAM) is a library of computer based tests designed to measure cognitive function at a single time-point or longitudinally for detection of cognitive change. This study sought to validate ANAM as a cognitive screening tool for presence of confirmed neuropsychological diagnosis in an outpatient setting. Retrospective data analysis was conducted for 139 patients referred for outpatient neuropsychological assessment. Clinical diagnosis was made independent of ANAM test results and resulted in a diagnostic mix of both neurologic and psychologic etiologies. ANAM scores predictive of presence of confirmed diagnosis were identified using multiple logistic regression and the predictive ability of the resulting model was quantified using receiver operator characteristic analysis. Sensitivity and specificity for the ANAM when combined with anger and depressive symptom scores were 71% and 91%, respectively, with a positive predictive value of 97.5 and negative predictive value of 40.4. This combined approach provided the greatest accuracy for individual tests as well as the composite score of the ANAM in identifying those who received a subsequent clinical diagnosis. Although data should be replicated in larger samples, these results suggest that ANAM may have predictive value and may be a useful screening tool for identifying those who would likely benefit from neuropsychological services.

Test-retest reliability and practice effects for the ANAM General Neuropsychological Screening battery.

OBJECTIVE: As the use of computer-based neurocognitive assessment is rapidly expanding, the need to systematically study and document key psychometric properties of these measures has become increasingly more salient. To meet this aim, this study examined test-retest reliability and practice effects for the Automated Neuropsychological Assessment Metrics General Neuropsychological Screening battery (ANAM GNS) in a sample of 94 community dwelling adults. METHOD: ANAM GNS was administered and then repeated (alternate form) after 30 days. Test-retest reliability, practice effects, and the standard error of measurement were calculated. Using these estimates, reliable change indices were calculated to determine degree of performance change needed to exceed chance and measurement error (with 90% confidence interval). RESULTS: The test-retest reliability for the ANAM composite score was .91. Performance significantly improved upon retest, but the effect size was small consistent with minimal practice effects. The threshold indicating change beyond chance or measurement error with 90% certainty was .9 (z-score). CONCLUSIONS: Findings suggest that the ANAM GNS has excellent test-retest reliability upon retest at 30 days. Small practice effects can be expected. Change greater than .9 standard deviations in the ANAM composite score is likely to represent meaningful clinical change. This paper presents initial psychometric data from the ANAM GNS and supports its use as a reliable measure of cognition.

Classification accuracy of the Minnesota Multiphasic Personality Inventory-2 (MMPI-2)-Restructured form validity scales in detecting malingered pain-related disability.

The symptom reports of individuals with chronic pain are multidimensional (e.g., emotional, cognitive, and somatic) and significantly contribute to increased morbidity and lost work productivity. When pain occurs in the context of a legally compensable event, reliable assessment of a patient's multifactorial symptom experience during psychological or neuropsychological evaluations is a necessity. The Validity Scales of the Minnesota Multiphasic Personality Inventory-2 (MMPI-2) have been shown useful in identifying symptom overreporting and feigning within chronic pain samples and a number of studies have emerged supporting the use of the MMPI-2-Restructured Form (MMPI-2-RF) in the detection of simulated or feigned impairment in a variety of populations. To date, only 1 other study exists examining the ability of the MMPI-2-RF to detect exaggerated complaints using a strict operationalization of malingering exclusive to chronic pain samples. The purpose of this study was to examine the classification accuracy of MMPI-2-RF Validity Scales in a group of patients with chronic pain using a criterion-groups design. The final sample consisted of 501 clinical chronic pain patients assigned to groups based on the Bianchini, Greve, and Glynn (2005) criteria for Malingered Pain-Related Disability (MPRD). Results showed that all MMPI-2-RF Validity Scales differentiated malingerers from nonmalingerers with a high degree of accuracy. At cut-offs associated with ≥95% Specificity, Sensitivities ranged from 15% (Fs) to 60% (Response Bias Scale; RBS). This study demonstrates that the MMPI-2-RF Validity Scales are capable of differentiating intentional symptom exaggeration from genuine complaints in a sample of incentivized chronic pain patients. (PsycINFO Database Record

Cognitive Screening Tests Versus Comprehensive Neuropsychological Test Batteries: A National Academy of Neuropsychology Education Paper†.

The American Medical Association Current Procedural Panel developed a new billing code making behavioral health screening a reimbursable healthcare service. The use of computerized testing as a means for cognitive screening and brief cognitive testing is increasing at a rapid rate. The purpose of this education paper is to provide information to clinicians, healthcare administrators, and policy developers about the purpose, strengths, and limitations of cognitive screening tests versus comprehensive neuropsychological evaluations. Screening tests are generally brief and narrow in scope, they can be administered during a routine clinical visit, and they can be helpful for identifying individuals in need of more comprehensive assessment. Some screening tests can also be helpful for monitoring treatment outcomes. Comprehensive neuropsychological assessments are multidimensional in nature and used for purposes such as identifying primary and secondary diagnoses, determining the nature  and severity of a person's cognitive difficulties, determining functional limitations, and planning treatment and rehabilitation. Cognitive screening tests are expected to play an increasingly important role in identifying individuals with cognitive impairment and in determining which individuals should be referred for further neuropsychological assessment. However, limitations of existing cognitive screening tests are present and cognitive screening tests should not be used as a replacement for comprehensive neuropsychological testing.

Cognitive Performance Scores for the Pediatric Automated Neuropsychological Assessment Metrics in Childhood-Onset Systemic Lupus Erythematosus.

OBJECTIVE: To develop and initially validate a global cognitive performance score (CPS) for the Pediatric Automated Neuropsychological Assessment Metrics (PedANAM) to serve as a screening tool of cognition in childhood lupus. METHODS: Patients (n = 166) completed the 9 subtests of the PedANAM battery, each of which provides 3 principal performance parameters (accuracy, mean reaction time for correct responses, and throughput). Cognitive ability was measured by formal neurocognitive testing or estimated by the Pediatric Perceived Cognitive Function Questionnaire-43 to determine the presence or absence of neurocognitive dysfunction (NCD). A subset of the data was used to develop 4 candidate PedANAM-CPS indices with supervised or unsupervised statistical approaches: PedANAM-CPSUWA , i.e., unweighted averages of the accuracy scores of all PedANAM subtests; PedANAM-CPSPCA , i.e., accuracy scores of all PedANAM subtests weighted through principal components analysis; PedANAM-CPSlogit , i.e., algorithm derived from logistic models to estimate NCD status based on the accuracy scores of all of the PedANAM subtests; and PedANAM-CPSmultiscore , i.e., algorithm derived from logistic models to estimate NCD status based on select PedANAM performance parameters. PedANAM-CPS candidates were validated using the remaining data. RESULTS: PedANAM-CPS indices were moderately correlated with each other (|r| > 0.65). All of the PedANAM-CPS indices discriminated children by NCD status across data sets (P < 0.036). The PedANAM-CPSmultiscore had the highest area under the receiver operating characteristic curve (AUC) across all data sets for identifying NCD status (AUC >0.74), followed by the PedANAM-CPSlogit , the PedANAM-CPSPCA , and the PedANAM-CPSUWA , respectively. CONCLUSION: Based on preliminary validation and considering ease of use, the PedANAM-CPSmultiscore and the PedANAM-CPSPCA appear to be best suited as global measures of PedANAM performance.

Blood-based candidate biomarkers of the presence of neuropsychiatric systemic lupus erythematosus in children.

OBJECTIVE: To examine select brain-reactive proteins for their usefulness to serve as blood-based biomarkers in the screening for neurocognitive deficits in childhood-onset systemic lupus erythematosus (cSLE-NCD). METHODS: Patients withcSLE (n=40) were studied longitudinally (month 1; month 18): working memory, psychomotor speed and visuoconstructional ability were assessed using formal neurocognitive testing to determine the presence of cSLE-NCD. Patients also completed the computerised Paediatric Automated Neuropsychological Assessment Metrics. The following brain-reactive proteins were measured in the blood: neutrophil gelatinase associated lipocalin (NGAL), S100B, S100A8/9, antibodies to NR2 glutamate receptor (aNR2-AB), ribosomal-P (aP-AB), glycoprotein-1 (aGP1-AB), and lupus anticoagulant. RESULTS: cSLE-NCD was present in 6 of 40 patients at baseline and 4 of 27 patients with 18-month information. aP-AB positivity was more commonly present with cSLE-NCD than without (p=0.05). aP-ABs were negatively associated with performance on tests assessing working memory, psychomotor speed and visuoconstructional ability in using formal neurocognitive testing. There were also significant negative associations between aP-AB, S100A8/9, aNR2-AB, aGP1-AB, and lupus anticoagulant and accuracy rates on select Paediatric Automated Neuropsychological Assessment Metrics subtests (p<0.05). Over time, decline in cognitive performance was more pronounced among patients with higher NGAL and aNR2-AB levels. Combinations of serum levels of S100A8/9, S100B, NGAL, aNR2-AB and aP-AB were able to identify cSLE-NCD (sensitivity: 100%; specificity 76%) in exploratory analysis. CONCLUSIONS: Select brain-reactive proteins in the blood are associated with cognitive performance and the presence of cSLE-NCD, cross-sectionally and over time. This raises the possibility that testing of these proteins may assist with the screening of cSLE-NCD.

Cognitive changes and dementia risk after traumatic brain injury: implications for aging military personnel.

Traumatic brain injury (TBI) is recognized as an important risk factor for the long-term cognitive health of military personnel, particularly in light of growing evidence that TBI increases risk for Alzheimer's disease and other dementias. In this article, we review the neurocognitive and neuropathologic changes after TBI with particular focus on the potential risk for cognitive decline across the life span in military service members. Implications for monitoring and surveillance of cognition in the aging military population are discussed. Additional studies are needed to clarify the factors that increase risk for later life cognitive decline, define the mechanistic link between these factors and dementia, and provide empirically supported interventions to mitigate the impact of TBI on cognition across the life span.

360 Degree advocacy: a model for high impact advocacy in a rapidly changing healthcare marketplace.

In an era of rapid changes in the healthcare marketplace the specialty of clinical neuropsychology faces a substantial increase in advocacy challenges. These include maintaining both access to services and a favorable practice climate as new healthcare structures and payment models evolve. The issue of regional variability complicates an effective response to these challenges from national professional organizations. One response to the challenge of regional variability is to strengthen our national organizations' capacity to engage in coordinated and effective advocacy, and to partner with state and regional neuro/psychological associations. The Inter-Organizational Practice Committee (IOPC) was formed in 2012 to meet this need. The IOPC has developed a model of 360 Degree Advocacy that coordinates local, regional, and national resources for high-impact, efficient advocacy. This paper describes the 360 Degree Advocacy model, and walks readers through an example of the model in action, successfully responding to a threat to patient access and practice climate with a regional Medicare carrier.

Initial clinical validation of an embedded performance validity measure within the automated neuropsychological metrics (ANAM).

The measurement of effort and performance validity is essential for computerized testing where less direct supervision is needed. The clinical validation of an Automated Neuropsychological Metrics-Performance Validity Index (ANAM-PVI) was examined by converting ANAM test scores into a common metric based on their relative infrequency in an outpatient clinic sample with presumed good effort. Optimal ANAM-PVI cut-points were determined using receiver operator characteristic (ROC) curve analyses and an a priori specificity of 90%. Sensitivity/specificity was examined in available validation samples (controls, simulators, and neurorehabilitation patients). ANAM-PVI scores differed between groups with simulators scoring the highest. ROC curve analysis indicated excellent discriminability of ANAM-PVI scores ≥5 to detect simulators versus controls (area under the curve = 0.858; odds ratio for detecting suboptimal performance = 15.6), but resulted in a 27% false-positive rate in the clinical sample. When specificity in the clinical sample was set at 90%, sensitivity decreased (68%), but was consistent with other embedded effort measures. Results support the ANAM-PVI as an embedded effort measure and demonstrate the value of sample-specific cut-points in groups with cognitive impairment. Examination of different cut-points indicates that clinicians should choose sample-specific cut-points based on sensitivity and specificity rates that are most appropriate for their patient population with higher cut-points for those expected to have severe cognitive impairment (e.g., dementia or severe acquired brain injury).

Evidence for added value of baseline testing in computer-based cognitive assessment.

CONTEXT: Large-scale baseline cognitive assessment for individuals at risk for concussion is a common part of the protocol for concussion-surveillance programs, particularly in sports. Baseline cognitive testing is also being conducted in US military service members before deployment. Recently, the incremental validity of large-scale baseline cognitive assessment has been questioned. OBJECTIVE: To examine the added value of baseline cognitive testing in computer-based neuropsychological assessment by comparing 2 methods of classifying atypical performance in a presumed healthy sample. DESIGN: Cross-sectional study. SETTING: Military base. PATIENTS OR OTHER PARTICIPANTS: Military service members who took the Automated Neuropsychological Assessment Matrix (ANAM) before and after deployment (n = 8002). MAIN OUTCOME MEASURE(S): Rates of atypical performance in this healthy, active-duty sample were determined first by comparing postdeployment scores with a military normative database and then with each individual's personal baseline performance using a reliable change index. RESULTS: Overall rates of atypical performance were comparable across these 2 methods. However, these methods were highly discordant in terms of which individuals were classified as atypical. When norm-referenced methods were used, 2.6% of individuals classified as normal actually demonstrated declines from baseline. Further, 65.7% of individuals classified as atypical using norm-referenced scores showed no change from baseline (ie, potential false-positive findings). CONCLUSIONS: Knowing an individual's baseline performance is important for minimizing potential false-positive errors and reducing the risks and stresses of misdiagnosis.

Efficacy of the ANAM General Neuropsychological Screening Battery (ANAM GNS) for detecting neurocognitive impairment in a mixed clinical sample.

The Automated Neuropsychological Assessment Metrics (ANAM) is a computerized neuropsychological assessment battery that has demonstrated utility in a variety of clinical populations including multiple sclerosis, systemic lupus erythematosus, Parkinson's disease, acquired brain injury, migraine headaches, and Alzheimer's disease. This study utilized selected tests from the ANAM General Neuropsychological Screening Battery (ANAM GNS), a newly defined subset of tests from the broader ANAM library designed for general clinical assessment of cognition. ANAM GNS is an expansion of the ANAM Core battery which has been utilized in a military setting. The efficacy of the ANAM GNS was explored in a mixed clinical sample relative to well-established, traditional neuropsychological measure, the Repeatable Battery for the Assessment of Neuropsychological Status (RBANS). It was hypothesized that scores from the ANAM GNS would accurately predict participants as either impaired (n = 30) or normal (n = 113). Participants were grouped a priori based on RBANS Total Index scores with impairment defined as scores ≤ 15th percentile. Logistic regression analysis was conducted to evaluate the classification accuracy of the ANAM GNS. The predictor variables were the Throughput scores from seven selected ANAM GNS subtests. The full model significantly predicted impairment status, sensitivity was 81% and specificity was 89.1%. Overall classification rate was 87.9% and the Odds Ratio for the overall model was 34.65. Positive predictive value was 56.7% and negative predictive value was 96.4%. This study represents the first clinical data on the ANAM GNS, and documents that it has good concurrent and predictive validity with a well-established neuropsychological measure.

Validation of the Pediatric Automated Neuropsychological Assessment Metrics in childhood-onset systemic lupus erythematosus.

OBJECTIVE: To evaluate the reproducibility and validity of the Pediatric Automated Neuropsychological Assessment Metrics (Ped-ANAM) when used in childhood-onset systemic lupus erythematosus (cSLE). METHODS: Forty children with cSLE and 40 matched controls were followed for up to 18 months. Formal neuropsychological testing at baseline was repeated after 18 months of followup; overall cognitive performance and domain-specific cognition (attention, working memory, processing speed, and visuoconstructional ability) were measured and categorized as normal cognition, mild/moderate, or moderate/severe impairment. The 10 Ped-ANAM subtests were completed every 6 months and twice at baseline. Ped-ANAM performance was based on accuracy (AC), mean time to correct response (MNc), throughput, and coefficient of variation of the time required for a correct response (CVc) as a measure of response consistency. RESULTS: Particularly, MNc scores demonstrated moderate to substantial reproducibility (intraclass correlation coefficients 0.47-0.80). Means of select Ped-ANAM scores (MNc, AC, CVc) differed significantly between children with different levels of cognitive performance and allowed for the detection of moderate or severe cognitive impairment with 100% sensitivity and 86% specificity. Six Ped-ANAM subtests significantly correlated with the change in overall cognitive function in cSLE (baseline versus 18 months; Spearman's correlation coefficient >0.4, P < 0.05; n = 24). CONCLUSION: The Ped-ANAM has moderate to substantial reproducibility, criterion and construct validity, and may be responsive to change in cSLE. Additional research is required to confirm the outstanding accuracy of the Ped-ANAM in identifying cognitive impairment, as well as its usefulness in detecting clinically relevant changes in cognition over time.

Effects of military deployment on cognitive functioning.

Military deployment poses many risks for cognitive functioning. When deployed individuals are compared to a nondeployed control group, there is some evidence that deployment may be associated with declines in cognitive functioning. The current study examined cognitive performance before and following deployment in a large sample of active duty military personnel (N = 8002) who reported no traumatic brain injury (TBI). Cognition was assessed using the Automated Neuropsychological Assessment Metrics version 4 TBI Military (ANAM4 TBI-MIL) battery, a computer-based battery of tests measuring attention, processing speed, and general cognitive efficiency. Pre- and postdeployment scores were compared using repeated measures analyses. Although statistically significant differences were observed for all tests (with 5 of 7 tests demonstrating performance improvement), effect sizes were very small for all but 1 test, indicating that performance differences had minimal clinical significance. Likewise, determination of change for individuals using reliable change indices revealed that a very small percentage (<3%) of this presumed healthy sample showed meaningful decline in cognition following deployment. Analyses indicated that despite risks for cognitive decline while in theater, deployment had minimal to no lasting effect on cognition as measured by ANAM4 TBI-Mil upon return from deployment.

Automated Neuropsychological Assessment Metrics (v4) Traumatic Brain Injury Battery: military normative data.

The aim of the present study was to establish normative data for the Automated Neuropsychological Assessment Metrics (v4) Traumatic Brain Injury (ANAM4 TBI) battery in a military context. ANAM4 data from over 107,500 active duty service members ranging from 17 to 65 years of age were included in this study. The influence of the demographic variables of age and gender were also examined. These norms, stratified by age and gender, represent a more comprehensive set of norms than previously available and are provided as a representative set of norms for clinical practice. Additionally, base rates of below average performance in a normal population are provided to help inform clinical decision making.