Assessing the Utility of the Montreal Cognitive Assessment in Screening for Cognitive Impairment in Patients With Systemic Lupus Erythematosus.

OBJECTIVE: Screening for cognitive impairment (CI) in systemic lupus erythematosus (SLE) relies on the American College of Rheumatology (ACR) neuropsychological battery (NB). By studying the concurrent criterion validity, our goal was to assess the Montreal Cognitive Assessment (MoCA) as a screening tool for CI compared to the ACR-NB and to evaluate the added value of the MoCA to the Automated Neuropsychological Assessment Metrics (ANAM). METHODS: A total of 285 adult SLE patients were administered the ACR-NB, MoCA, and ANAM. For the ACR-NB, patients were classified as having CI if there was a Z score of ≤-1.5 in ≥2 domains. The area under the curve (AUC) and sensitivities/specificities were determined. A discriminant function analysis was applied to assess the ability of the MoCA to differentiate between CI, undetermined CI, and non-CI patients. RESULTS: CI was not accurately identified by the MoCA compared to the ACR-NB (AUC of 0.66). Sensitivity and specificity were poor at 50% and 69%, respectively, for the cutoff of 26, and 80% and 45%, respectively, for the cutoff of 28. The MoCA had a low ability to identify CI status. The addition of the MoCA to the ANAM led to improvement on the AUC by only 2.5%. CONCLUSION: The MoCA does not have adequate concurrent criterion validity to accurately identify CI in patients with SLE. The low specificity of the MoCA may lead to overdiagnosis and concern among patients. Adding the MoCA to the ANAM does not substantially improve the accuracy of the ANAM. These results do not support using the MoCA as a screening tool for CI in patients with SLE.

Validation of the automated neuropsychological assessment metrics for assessing cognitive impairment in systemic lupus erythematosus.

OBJECTIVE: We previously demonstrated the utility of the Automated Neuropsychological Assessment Metrics (ANAM) for screening cognitive impairment (CI) in patients with systemic lupus erythematosus (SLE) and developed composite indices for interpreting ANAM results. Our objectives here were to provide further support for the ANAM's concurrent criterion validity against the American College of Rheumatology neuropsychological battery (ACR-NB), identify the most discriminatory subtests and scores of the ANAM for predicting CI, and provide a new approach to interpret ANAM results using Classification and Regression Tree (CART) analysis. METHODS: 300 adult SLE patients completed an adapted ACR-NB and ANAM on the same day. As per objectives, six models were built using combinations of ANAM subtests and scores and submitted to CART analysis. Area under the curve (AUC) was calculated to evaluate the ANAM's criterion validity compared to the adapted ACR-NB; the most discriminatory ANAM subtests and scores in each model were selected, and performance of models with the highest AUCs were compared to our previous composite indices; decision trees were generated for models with the highest AUCs. RESULTS: Two models had excellent AUCs of 86 and 89%. Eight most discriminatory ANAM subtests and scores were identified. Both models demonstrated higher AUCs against our previous composite indices. An adapted decision tree was created to simplify the interpretation of ANAM results. CONCLUSION: We provide further validity evidence for the ANAM as a valid CI screening tool in SLE. The decision tree improves interpretation of ANAM results, enhancing clinical utility.

Validity Evidence for the Use of Automated Neuropsychologic Assessment Metrics As a Screening Tool for Cognitive Impairment in Systemic Lupus Erythematosus.

OBJECTIVE: Screening for cognitive impairment in systemic lupus erythematosus (SLE) conventionally relies on the American College of Rheumatology (ACR) neuropsychologic battery (NB), which is not universally available. To develop a more accessible screening approach, we assessed validity of the Automated Neuropsychological Assessment Metrics (ANAM). Using the ACR NB as the gold standard for cognitive impairment classification, the objectives were 1) to measure overall discriminative validity of the ANAM for cognitive impairment versus no cognitive impairment, 2) to identify ANAM subtests and scores that best differentiate patients with cognitive impairment from those with no cognitive impairment, and 3) to derive ANAM composite indices and cutoffs. METHODS: A total of 211 consecutive adult patients, female and male, with SLE were administered the ANAM and ACR NB. 1) For overall discriminative validity of the ANAM, we compared patients with cognitive impairment versus those with no cognitive impairment on 4 scores. 2) Six ANAM models using different scores were developed, and the most discriminatory subtests were selected using logistic regression analyses. The area under the receiver operating characteristic curve (AUC) was calculated to establish ANAM validity against the ACR NB. 3) ANAM composite indices and cutoffs were derived for the best models, and sensitivities and specificities were calculated. RESULTS: Patients with no cognitive impairment performed better on most ANAM subtests, supporting ANAM's discriminative validity. Cognitive impairment could be accurately identified by selected ANAM subtests with top models, demonstrating excellent AUCs of 81% and 84%. Derived composite indices and cutoffs demonstrated sensitivity of 78-80% and specificity of 70%. CONCLUSION: This study provides support for ANAM's discriminative validity for cognitive impairment and utility for cognitive screening in adult SLE. Derived composite indices and cutoffs enhance clinical applicability.

Assessment of the psychometric properties of patient-reported outcomes of depression and anxiety in systemic lupus erythematosus.

OBJECTIVES: This study aimed to: 1) determine the prevalence of depression and anxiety in SLE patients using the Center for Epidemiological Studies-Depression Scale [CES-D], Hospital Anxiety and Depression Scale [HADS], and Beck Anxiety Inventory [BAI] questionnaires; 2) study the criterion validity, interpretability, and test-retest reliability of CES-D, HADS and BAI; and 3) evaluate their diagnostic accuracy when compared to the assessment of an independent psychiatric assessment using the Mini-International Neuropsychiatric Interview (MINI). METHODS: 159 consecutive SLE participants were screened for depression and anxiety using the CES-D, HADS, and BAI, and underwent the MINI. Sensitivity and specificity were evaluated against the MINI. Test-retest reliability was studied. Receiver operator characteristic (ROC) curves were utilized to determine the cut-off scores for CES-D, HADS and BAI. RESULTS: The prevalence of depression ranged from 29% (HADS-D) to 52% (CES-D) and the prevalence of anxiety ranged from 45% (BAI) to 50% (HADS-A). ROC showed similar performance for CES-D and HADS-D. The diagnostic accuracy of HADS-A outperformed BAI. Furthermore, these self-reported questionnaires demonstrated good to excellent test-retest reliability. Analyses exhibited optimal cut-offs for CES-D (26), BAI (19), HADS-A (6), and HADS-D (8) that optimized their sensitivity and specificity as screening metrics for depression and anxiety in SLE patients. CONCLUSIONS: Anxiety and depression are highly prevalent in patients with SLE. Patient-reported outcome questionnaires such as the CES-D, HADS, and BAI may be useful tools to screen for depression and anxiety in SLE. Our results suggest that SLE-specific cut-offs may improve diagnostic accuracy of current screening metrics in patients with lupus.