Assessing the Utility of the Montreal Cognitive Assessment in Screening for Cognitive Impairment in Patients With Systemic Lupus Erythematosus.

OBJECTIVE: Screening for cognitive impairment (CI) in systemic lupus erythematosus (SLE) relies on the American College of Rheumatology (ACR) neuropsychological battery (NB). By studying the concurrent criterion validity, our goal was to assess the Montreal Cognitive Assessment (MoCA) as a screening tool for CI compared to the ACR-NB and to evaluate the added value of the MoCA to the Automated Neuropsychological Assessment Metrics (ANAM). METHODS: A total of 285 adult SLE patients were administered the ACR-NB, MoCA, and ANAM. For the ACR-NB, patients were classified as having CI if there was a Z score of ≤-1.5 in ≥2 domains. The area under the curve (AUC) and sensitivities/specificities were determined. A discriminant function analysis was applied to assess the ability of the MoCA to differentiate between CI, undetermined CI, and non-CI patients. RESULTS: CI was not accurately identified by the MoCA compared to the ACR-NB (AUC of 0.66). Sensitivity and specificity were poor at 50% and 69%, respectively, for the cutoff of 26, and 80% and 45%, respectively, for the cutoff of 28. The MoCA had a low ability to identify CI status. The addition of the MoCA to the ANAM led to improvement on the AUC by only 2.5%. CONCLUSION: The MoCA does not have adequate concurrent criterion validity to accurately identify CI in patients with SLE. The low specificity of the MoCA may lead to overdiagnosis and concern among patients. Adding the MoCA to the ANAM does not substantially improve the accuracy of the ANAM. These results do not support using the MoCA as a screening tool for CI in patients with SLE.

Validation of the automated neuropsychological assessment metrics for assessing cognitive impairment in systemic lupus erythematosus.

OBJECTIVE: We previously demonstrated the utility of the Automated Neuropsychological Assessment Metrics (ANAM) for screening cognitive impairment (CI) in patients with systemic lupus erythematosus (SLE) and developed composite indices for interpreting ANAM results. Our objectives here were to provide further support for the ANAM's concurrent criterion validity against the American College of Rheumatology neuropsychological battery (ACR-NB), identify the most discriminatory subtests and scores of the ANAM for predicting CI, and provide a new approach to interpret ANAM results using Classification and Regression Tree (CART) analysis. METHODS: 300 adult SLE patients completed an adapted ACR-NB and ANAM on the same day. As per objectives, six models were built using combinations of ANAM subtests and scores and submitted to CART analysis. Area under the curve (AUC) was calculated to evaluate the ANAM's criterion validity compared to the adapted ACR-NB; the most discriminatory ANAM subtests and scores in each model were selected, and performance of models with the highest AUCs were compared to our previous composite indices; decision trees were generated for models with the highest AUCs. RESULTS: Two models had excellent AUCs of 86 and 89%. Eight most discriminatory ANAM subtests and scores were identified. Both models demonstrated higher AUCs against our previous composite indices. An adapted decision tree was created to simplify the interpretation of ANAM results. CONCLUSION: We provide further validity evidence for the ANAM as a valid CI screening tool in SLE. The decision tree improves interpretation of ANAM results, enhancing clinical utility.

Can Sport Concussion Assessment Tool (SCAT) Symptom Scores Be Converted to Rivermead Post-concussion Symptoms Questionnaire (RPQ) Scores and Vice Versa? Findings From the Toronto Concussion Study.

Background: The Rivermead Post-Concussion Symptoms Questionnaire (RPQ) and the Sports Concussion Assessment Tool (SCAT) are widely used self-report tools assessing the type, number, and severity of concussion symptoms. There are overlapping symptoms and domains, though they are scored differently. The SCAT consists of 22 questions with a 7-point Likert scale for a total possible score 132. The RPQ has 16 questions and a 5-point Likert scale for a total of 64 possible points. Being able to convert between the two scores would facilitate comparison of results in the concussion literature. Objectives: To develop equations to convert scores on the SCAT to the RPQ and vice versa. Methods: Adults (17-85 years) diagnosed with a concussion at a referring emergency department were seen in the Hull-Ellis Concussion and Research Clinic, a rapid access concussion clinic at Toronto Rehab-University Health Network (UHN) Toronto Canada, within 7 days of injury. The RPQ and SCAT symptom checklists as well as demographic questionnaires were administered to all participants at Weeks 1, 2, 3, 4, 5, 6, 7, 8, 12, 16. Results: 215 participants had 1,168 matched RPQ and SCAT assessments. Total scores of the RPQ and the SCAT had a rho = 0.91 (p < 0.001); correlations were lower for sub-scores of specific symptom domains (range 0.74-0.87, p < 0.001 for all domain comparisons). An equation was derived to calculate SCAT scores using the number and severity of symptoms on the RPQ. Estimated scores were within 3 points of the observed total score on the SCAT. A second equation was derived to calculate the RPQ from the proportion weighted total score of the SCAT. This equation estimated corresponding scores within 3 points of the observed score on the RPQ. Conclusions: The RPQ and SCAT symptom checklists total scores are highly correlated and can be used to estimate the total score on the corresponding assessment. The symptom subdomains are also strongly correlated between the 2 scales however not as strongly correlated as the total score. The equations will enable researchers and clinicians to quickly convert between the scales and to directly compare concussion research findings.

Metrics and definitions used in the assessment of cognitive impairment in systemic lupus erythematosus: A systematic review.

OBJECTIVE: To review: 1) degree of conformity to the American College of Rheumatology neuropsychological battery (ACR-NB) among studies that used a NB, 2) review definitions of cognitive impairment (CI) from studies that used a NB, and 3) characterize measurement tools used to assess CI in systemic lupus erythematosus (SLE). METHODS: The literature search was conducted in Ovid Medline, Embase, and PsycINFO for articles on CI in adult SLE patients. We reviewed studies that used a NB and compared their tests to the ACR-NB to assess the degree of conformity. Definitions of CI from studies that used a NB were reviewed when sufficient information was available. We reviewed and categorized CI measurement tools into four broad categories: NB, screening, incomplete/mixed batteries, and computerized batteries. RESULTS: Of 8727 references, 118 were selected for detailed review and 97 were included in the final analysis. Of 43 studies that used a NB, none of the studies used the ACR-NB exactly as published. Many studies supplemented with other tests. Overall, there was inconsistent use of ACR-NB tests. Definitions for CI varied, with cut-offs ranging from 1 to 3 standard deviations below normative values on domains/tests varying in type and number. The most frequently used measurement tool for assessing CI in SLE was a NB. Use of screening tests and computerized batteries have also increased over the last decade. CONCLUSION: The assessment and definition of CI in SLE remains heterogeneous. A consensus meeting to address existing inconsistencies should be considered to harmonize the field of CI in SLE.

Validity Evidence for the Use of Automated Neuropsychologic Assessment Metrics As a Screening Tool for Cognitive Impairment in Systemic Lupus Erythematosus.

OBJECTIVE: Screening for cognitive impairment in systemic lupus erythematosus (SLE) conventionally relies on the American College of Rheumatology (ACR) neuropsychologic battery (NB), which is not universally available. To develop a more accessible screening approach, we assessed validity of the Automated Neuropsychological Assessment Metrics (ANAM). Using the ACR NB as the gold standard for cognitive impairment classification, the objectives were 1) to measure overall discriminative validity of the ANAM for cognitive impairment versus no cognitive impairment, 2) to identify ANAM subtests and scores that best differentiate patients with cognitive impairment from those with no cognitive impairment, and 3) to derive ANAM composite indices and cutoffs. METHODS: A total of 211 consecutive adult patients, female and male, with SLE were administered the ANAM and ACR NB. 1) For overall discriminative validity of the ANAM, we compared patients with cognitive impairment versus those with no cognitive impairment on 4 scores. 2) Six ANAM models using different scores were developed, and the most discriminatory subtests were selected using logistic regression analyses. The area under the receiver operating characteristic curve (AUC) was calculated to establish ANAM validity against the ACR NB. 3) ANAM composite indices and cutoffs were derived for the best models, and sensitivities and specificities were calculated. RESULTS: Patients with no cognitive impairment performed better on most ANAM subtests, supporting ANAM's discriminative validity. Cognitive impairment could be accurately identified by selected ANAM subtests with top models, demonstrating excellent AUCs of 81% and 84%. Derived composite indices and cutoffs demonstrated sensitivity of 78-80% and specificity of 70%. CONCLUSION: This study provides support for ANAM's discriminative validity for cognitive impairment and utility for cognitive screening in adult SLE. Derived composite indices and cutoffs enhance clinical applicability.

Ecologically valid assessment of executive dysfunction using a novel virtual reality task in patients with acquired brain injury.

The current investigation sought to further establish the psychometric properties and ecological validity of the Multitasking in the City Test (MCT) in a clinical population. Ecological validity was addressed via correlational analyses between performance on this test and a subjective measure of everyday executive functioning (Frontal Systems Behavior Scale; FrSBe). The sample was composed of 13 individuals (11 males) who suffered a stroke or traumatic brain injury. A neuropsychological test battery consisting of the MCT and common executive and nonexecutive measures was administered. The only executive function tests that were significantly related to the FrSBe were the MCT and a semantic fluency test. Compared with a sample of normal participants, the patient group produced better plans but completed fewer tasks on the MCT. Patients made similar types of errors as normals, although some of these errors occurred more frequently in the patient sample. This study demonstrated the ecological validity of the MCT and suggested that patients can be differentiated from healthy individuals by quantitative (i.e., number of errors) rather than qualitative (i.e., type of errors) aspects of performance. Further interpretation of MCT performance and comparison with existing executive function tests is discussed.

Depression and neurocognitive functioning in mild traumatic brain injury patients referred for assessment.

The relationship between depression and performance on selected neurocognitive tests was examined in two mild head injury samples (n1 = 72, n2 = 50). A series of hierarchical regression analyses showed that scores on depression-related scales of both the MCMI-II (Millon Clinical Multi-Axial Inventory; Millon, 1987) and MMPI-2 (Minnesota Multiphasic Personality Inventory; Hathaway & McKinley, 1989) were largely independent of cognitive performance. Depression may be prevalent in mild injury, but it is unlikely to mediate deficits observed on commonly used measures of problem solving, visual-motor speed, prose and figural recall.