Validation of an Automated Speech Analysis of Cognitive Tasks within a Semiautomated Phone Assessment.

Introduction: We studied the accuracy of the automatic speech recognition (ASR) software by comparing ASR scores with manual scores from a verbal learning test (VLT) and a semantic verbal fluency (SVF) task in a semiautomated phone assessment in a memory clinic population. Furthermore, we examined the differentiating value of these tests between participants with subjective cognitive decline (SCD) and mild cognitive impairment (MCI). We also investigated whether the automatically calculated speech and linguistic features had an additional value compared to the commonly used total scores in a semiautomated phone assessment. Methods: We included 94 participants from the memory clinic of the Maastricht University Medical Center+ (SCD N = 56 and MCI N = 38). The test leader guided the participant through a semiautomated phone assessment. The VLT and SVF were audio recorded and processed via a mobile application. The recall count and speech and linguistic features were automatically extracted. The diagnostic groups were classified by training machine learning classifiers to differentiate SCD and MCI participants. Results: The intraclass correlation for inter-rater reliability between the manual and the ASR total word count was 0.89 (95% CI 0.09-0.97) for the VLT immediate recall, 0.94 (95% CI 0.68-0.98) for the VLT delayed recall, and 0.93 (95% CI 0.56-0.97) for the SVF. The full model including the total word count and speech and linguistic features had an area under the curve of 0.81 and 0.77 for the VLT immediate and delayed recall, respectively, and 0.61 for the SVF. Conclusion: There was a high agreement between the ASR and manual scores, keeping the broad confidence intervals in mind. The phone-based VLT was able to differentiate between SCD and MCI and can have opportunities for clinical trial screening.

The value of maintaining cognition in patients with mild cognitive impairment: The innovation headroom and potential cost-effectiveness of roflumilast.

INTRODUCTION: Early health-technology assessment can support discussing scarce resource allocation among stakeholders. We explored the value of maintaining cognition in patients with mild cognitive impairment (MCI) by estimating: (1) the innovation headroom and (2) the potential cost effectiveness of roflumilast treatment in this population. METHODS: The innovation headroom was operationalized by a fictive 100% efficacious treatment effect, and the roflumilast effect on memory word learning test was assumed to be associated with 7% relative risk reduction of dementia onset. Both were compared to Dutch setting usual care using the adapted International Pharmaco-Economic Collaboration on Alzheimer's Disease (IPECAD) open-source model. RESULTS: The total innovation headroom expressed as net health benefit was 4.2 (95% bootstrap interval: 2.9-5.7) quality-adjusted life years (QALYs). The potential cost effectiveness of roflumilast was k€34 per QALY. DISCUSSION: The innovation headroom in MCI is substantial. Although the potential cost effectiveness of roflumilast treatment is uncertain, further research on its effect on dementia onset is likely valuable.