Validation of an Automated Speech Analysis of Cognitive Tasks within a Semiautomated Phone Assessment.

Introduction: We studied the accuracy of the automatic speech recognition (ASR) software by comparing ASR scores with manual scores from a verbal learning test (VLT) and a semantic verbal fluency (SVF) task in a semiautomated phone assessment in a memory clinic population. Furthermore, we examined the differentiating value of these tests between participants with subjective cognitive decline (SCD) and mild cognitive impairment (MCI). We also investigated whether the automatically calculated speech and linguistic features had an additional value compared to the commonly used total scores in a semiautomated phone assessment. Methods: We included 94 participants from the memory clinic of the Maastricht University Medical Center+ (SCD N = 56 and MCI N = 38). The test leader guided the participant through a semiautomated phone assessment. The VLT and SVF were audio recorded and processed via a mobile application. The recall count and speech and linguistic features were automatically extracted. The diagnostic groups were classified by training machine learning classifiers to differentiate SCD and MCI participants. Results: The intraclass correlation for inter-rater reliability between the manual and the ASR total word count was 0.89 (95% CI 0.09-0.97) for the VLT immediate recall, 0.94 (95% CI 0.68-0.98) for the VLT delayed recall, and 0.93 (95% CI 0.56-0.97) for the SVF. The full model including the total word count and speech and linguistic features had an area under the curve of 0.81 and 0.77 for the VLT immediate and delayed recall, respectively, and 0.61 for the SVF. Conclusion: There was a high agreement between the ASR and manual scores, keeping the broad confidence intervals in mind. The phone-based VLT was able to differentiate between SCD and MCI and can have opportunities for clinical trial screening.

The value of maintaining cognition in patients with mild cognitive impairment: The innovation headroom and potential cost-effectiveness of roflumilast.

INTRODUCTION: Early health-technology assessment can support discussing scarce resource allocation among stakeholders. We explored the value of maintaining cognition in patients with mild cognitive impairment (MCI) by estimating: (1) the innovation headroom and (2) the potential cost effectiveness of roflumilast treatment in this population. METHODS: The innovation headroom was operationalized by a fictive 100% efficacious treatment effect, and the roflumilast effect on memory word learning test was assumed to be associated with 7% relative risk reduction of dementia onset. Both were compared to Dutch setting usual care using the adapted International Pharmaco-Economic Collaboration on Alzheimer's Disease (IPECAD) open-source model. RESULTS: The total innovation headroom expressed as net health benefit was 4.2 (95% bootstrap interval: 2.9-5.7) quality-adjusted life years (QALYs). The potential cost effectiveness of roflumilast was k€34 per QALY. DISCUSSION: The innovation headroom in MCI is substantial. Although the potential cost effectiveness of roflumilast treatment is uncertain, further research on its effect on dementia onset is likely valuable.

Feasibility Study of an Internet-Based Platform for Tele-Neuropsychological Assessment of Elderly in Remote Areas.

Today, in rural isolated areas or so-called 'medical deserts', access to diagnosis and care is very limited. With the current pandemic crisis, now even more than ever, telemedicine platforms are gradually more employed for remote medical assessment. Only a few are tailored to comprehensive teleneuropsychological assessment of older adults. Hence, our study focuses on evaluating the feasibility of performing a remote neuropsychological assessment of older adults suffering from a cognitive complaint. 50 participants (aged 55 and older) were recruited at the local hospital of Digne-les-Bains, France. A brief neuropsychological assessment including a short clinical interview and several validated neuropsychological tests was administered in two conditions, once by Teleneuropsychology (TNP) and once by Face-to-Face (FTF) in a crossover design. Acceptability and user experience was assessed through questionnaires. Results show high agreement in most tests between the FTF and TNP conditions. The TNP was overall well accepted by the participants. However, differences in test performances were observed, which urges the need to validate TNP tests with broader samples with normative data.

Harmonizing neuropsychological assessment for mild neurocognitive disorders in Europe.

INTRODUCTION: Harmonized neuropsychological assessment for neurocognitive disorders, an international priority for valid and reliable diagnostic procedures, has been achieved only in specific countries or research contexts. METHODS: To harmonize the assessment of mild cognitive impairment in Europe, a workshop (Geneva, May 2018) convened stakeholders, methodologists, academic, and non-academic clinicians and experts from European, US, and Australian harmonization initiatives. RESULTS: With formal presentations and thematic working-groups we defined a standard battery consistent with the U.S. Uniform DataSet, version 3, and homogeneous methodology to obtain consistent normative data across tests and languages. Adaptations consist of including two tests specific to typical Alzheimer's disease and behavioral variant frontotemporal dementia. The methodology for harmonized normative data includes consensus definition of cognitively normal controls, classification of confounding factors (age, sex, and education), and calculation of minimum sample sizes. DISCUSSION: This expert consensus allows harmonizing the diagnosis of neurocognitive disorders across European countries and possibly beyond.

Remote cognitive assessment of older adults in rural areas by telemedicine and automatic speech and video analysis: protocol for a cross-over feasibility study.

INTRODUCTION: Early detection of cognitive impairments is crucial for the successful implementation of preventive strategies. However, in rural isolated areas or so-called 'medical deserts', access to diagnosis and care is very limited. With the current pandemic crisis, now even more than ever, remote solutions such as telemedicine platforms represent great potential and can help to overcome this barrier. Moreover, current advances made in voice and image analysis can help overcome the barrier of physical distance by providing additional information on a patients' emotional and cognitive state. Therefore, the aim of this study is to evaluate the feasibility and reliability of a videoconference system for remote cognitive testing empowered by automatic speech and video analysis. METHODS AND ANALYSIS: 60 participants (aged 55 and older) with and without cognitive impairment will be recruited. A complete neuropsychological assessment including a short clinical interview will be administered in two conditions, once by telemedicine and once by face-to-face. The order of administration procedure will be counterbalanced so half of the sample starts with the videoconference condition and the other half with the face-to-face condition. Acceptability and user experience will be assessed among participants and clinicians in a qualitative and quantitative manner. Speech and video features will be extracted and analysed to obtain additional information on mood and engagement levels. In a subgroup, measurements of stress indicators such as heart rate and skin conductance will be compared. ETHICS AND DISSEMINATION: The procedures are not invasive and there are no expected risks or burdens to participants. All participants will be informed that this is an observational study and their consent taken prior to the experiment. Demonstration of the effectiveness of such technology makes it possible to diffuse its use across all rural areas ('medical deserts') and thus, to improve the early diagnosis of neurodegenerative pathologies, while providing data crucial for basic research. Results from this study will be published in peer-reviewed journals.

Neuropsychological assessment and diagnostic disclosure at a memory clinic: A qualitative study of the experiences of patients and their family members.

OBJECTIVE: The aim of this study was to gain insight into the experiences of patients and their family members regarding a neuropsychological assessment (NPA) and the diagnostic disclosure given by the medical specialist (psychiatrist, geriatrician, or their residents) at the memory clinic (MC). METHOD: Patients with and without a cognitive impairment and their family members were recruited from three Dutch MCs. Four focus groups with 14 patients and 13 family members were analyzed using both inductive and deductive content analysis. RESULTS: Three themes were identified: uncertainty, early diagnostic paradox, and knowledge utilization. High levels of uncertainty were experienced throughout the NPA and diagnostic disclosure. The early diagnostic paradox refers to the coexistence of negative emotions, feeling distressed due to undergoing an NPA that made them aware of their cognitive complaints, and the experience of relief due to insight given by the outcome of the NPA and medical diagnosis. Knowledge utilization refers to a low retention of medical information. CONCLUSION: Clinicians can reduce uncertainty by using clear communication, limiting interruptions during an NPA, and paying attention to contextual factors. Low information retention could possibly be improved by involving a family member and using visual aids or written information during the diagnostic disclosure. Finally, participants also appreciated being provided with neuropsychological feedback on the strengths and weaknesses of their cognitive profiles and with guidance on how to manage this diagnosis in their daily lives.

The Diagnostic and Prognostic Value of Neuropsychological Assessment in Memory Clinic Patients.

BACKGROUND: Neuropsychological testing has long been embedded in daily clinical practice at memory clinics but the added value of a complete neuropsychological assessment (NPA) to standard clinical evaluation is unknown. OBJECTIVE: To evaluate the added diagnostic and prognostic value of NPA to clinical evaluation only in memory clinic patients. METHODS: In 221 memory clinic patients of a prospective cohort study, clinical experts diagnosed clinical syndrome (subjective cognitive impairment (SCI), mild cognitive impairment (MCI), or dementia) and etiology (Alzheimer's disease (AD) or no AD), and provided a prognosis of disease course (decline or no decline) before and after results of NPA were made available. The reference standard was a panel consensus based on all clinical information at baseline and up to 2 follow-up assessments. RESULTS: With NPA data available, clinicians changed their initial syndromal diagnosis in 22% of patients, and the etiological diagnosis as well as the prognosis in 15%. This led to an increase in correctly classified cases of 18% for syndromal diagnosis, 5% for etiological diagnosis, and 1% for prognosis. NPA data resulted in the largest improvement in patients initially classified as SCI (syndrome: 93.3% (n = 14) correctly reclassified, etiology: net reclassification improvement [NRI] = 0.61, prognosis: NRI = 0.13) or MCI (syndrome: 89.3% (n = 23) correctly reclassified, etiology: NRI = 0.17, prognosis: NRI = 0.14), while there was no improvement in patients with dementia (syndrome: 100% (n = 1) correctly reclassified, etiology: NRI = -0.05, prognosis: NRI = -0.06). Overall, inclusion of NPA in the diagnostic process increased confidence in all diagnoses with 6-7%. CONCLUSION: Administration of a complete NPA after standard clinical evaluation has added value for diagnosing cognitive syndrome and its underlying etiology in patients regarded as non-demented based on the first clinical impression.