Digital assessment of cognition in neurodegenerative disease: a data driven approach leveraging artificial intelligence.

Introduction: A rapid and reliable neuropsychological protocol is essential for the efficient assessment of neurocognitive constructs related to emergent neurodegenerative diseases. We developed an AI-assisted, digitally administered/scored neuropsychological protocol that can be remotely administered in ~10 min. This protocol assesses the requisite neurocognitive constructs associated with emergent neurodegenerative illnesses. Methods: The protocol was administered to 77 ambulatory care/memory clinic patients (56.40% women; 88.50% Caucasian). The protocol includes a 6-word version of the Philadelphia (repeatable) Verbal Learning Test [P(r)VLT], three trials of 5 digits backward from the Backwards Digit Span Test (BDST), and the "animal" fluency test. The protocol provides a comprehensive set of traditional "core" measures that are typically obtained through paper-and-pencil tests (i.e., serial list learning, immediate and delayed free recall, recognition hits, percent correct serial order backward digit span, and "animal" fluency output). Additionally, the protocol includes variables that quantify errors and detail the processes used in administering the tests. It also features two separate, norm-referenced summary scores specifically designed to measure executive control and memory. Results: Using four core measures, we used cluster analysis to classify participants into four groups: cognitively unimpaired (CU; n = 23), amnestic mild cognitive impairment (MCI; n = 17), dysexecutive MCI (n = 23), and dementia (n = 14). Subsequent analyses of error and process variables operationally defined key features of amnesia (i.e., rapid forgetting, extra-list intrusions, profligate responding to recognition foils); key features underlying reduced executive abilities (i.e., BDST items and dysexecutive errors); and the strength of the semantic association between successive responses on the "animal" fluency test. Executive and memory index scores effectively distinguished between all four groups. There was over 90% agreement between how cluster analysis of digitally obtained measures classified patients compared to classification using a traditional comprehensive neuropsychological protocol. The correlations between digitally obtained outcome variables and analogous paper/pencil measures were robust. Discussion: The digitally administered protocol demonstrated a capacity to identify patterns of impaired performance and classification similar to those observed with standard paper/pencil neuropsychological tests. The inclusion of both core measures and detailed error/process variables suggests that this protocol can detect subtle, nuanced signs of early emergent neurodegenerative illness efficiently and comprehensively.

Developing a fair and interpretable representation of the clock drawing test for mitigating low education and racial bias.

The clock drawing test (CDT) is a neuropsychological assessment tool to screen an individual's cognitive ability. In this study, we developed a Fair and Interpretable Representation of Clock drawing test (FaIRClocks) to evaluate and mitigate classification bias against people with less than 8 years of education, while screening their cognitive function using an array of neuropsychological measures. In this study, we represented clock drawings by a priorly published 10-dimensional deep learning feature set trained on publicly available data from the National Health and Aging Trends Study (NHATS). These embeddings were further fine-tuned with clocks from a preoperative cognitive screening program at the University of Florida to predict three cognitive scores: the Mini-Mental State Examination (MMSE) total score, an attention composite z-score (ATT-C), and a memory composite z-score (MEM-C). ATT-C and MEM-C scores were developed by averaging z-scores based on normative references. The cognitive screening classifiers were initially tested to see their relative performance in patients with low years of education (< = 8 years) versus patients with higher education (> 8 years) and race. Results indicated that the initial unweighted classifiers confounded lower education with cognitive compromise resulting in a 100% type I error rate for this group. Thereby, the samples were re-weighted using multiple fairness metrics to achieve sensitivity/specificity and positive/negative predictive value (PPV/NPV) balance across groups. In summary, we report the FaIRClocks model, with promise to help identify and mitigate bias against people with less than 8 years of education during preoperative cognitive screening.

Cerebral Microbleeds in Different Brain Regions and Their Associations With the Digital Clock-Drawing Test: Secondary Analysis of the Framingham Heart Study.

BACKGROUND: Cerebral microbleeds (CMB) increase the risk for Alzheimer disease. Current neuroimaging methods that are used to detect CMB are costly and not always accessible. OBJECTIVE: This study aimed to explore whether the digital clock-drawing test (DCT) may provide a behavioral indicator of CMB. METHODS: In this study, we analyzed data from participants in the Framingham Heart Study offspring cohort who underwent both brain magnetic resonance imaging scans (Siemens 1.5T, Siemens Healthcare Private Limited; T2*-GRE weighted sequences) for CMB diagnosis and the DCT as a predictor. Additionally, paper-based clock-drawing tests were also collected during the DCT. Individuals with a history of dementia or stroke were excluded. Robust multivariable linear regression models were used to examine the association between DCT facet scores with CMB prevalence, adjusting for relevant covariates. Receiver operating characteristic (ROC) curve analyses were used to evaluate DCT facet scores as predictors of CMB prevalence. Sensitivity analyses were conducted by further including participants with stroke and dementia. RESULTS: The study sample consisted of 1020 (n=585, 57.35% female) individuals aged 45 years and older (mean 72, SD 7.9 years). Among them, 64 (6.27%) participants exhibited CMB, comprising 46 with lobar-only, 11 with deep-only, and 7 with mixed (lobar+deep) CMB. Individuals with CMB tended to be older and had a higher prevalence of mild cognitive impairment and higher white matter hyperintensities compared to those without CMB (P<.05). While CMB were not associated with the paper-based clock-drawing test, participants with CMB had a lower overall DCT score (CMB: mean 68, SD 23 vs non-CMB: mean 76, SD 20; P=.009) in the univariate comparison. In the robust multiple regression model adjusted for covariates, deep CMB were significantly associated with lower scores on the drawing efficiency (ß=-0.65, 95% CI -1.15 to -0.15; P=.01) and simple motor (ß=-0.86, 95% CI -1.43 to -0.30; P=.003) domains of the command DCT. In the ROC curve analysis, DCT facets discriminated between no CMB and the CMB subtypes. The area under the ROC curve was 0.76 (95% CI 0.69-0.83) for lobar CMB, 0.88 (95% CI 0.78-0.98) for deep CMB, and 0.98 (95% CI 0.96-1.00) for mixed CMB, where the area under the ROC curve value nearing 1 indicated an accurate model. CONCLUSIONS: The study indicates a significant association between CMB, especially deep and mixed types, and reduced performance in drawing efficiency and motor skills as assessed by the DCT. This highlights the potential of the DCT for early detection of CMB and their subtypes, providing a reliable alternative for cognitive assessment and making it a valuable tool for primary care screening before neuroimaging referral.

Dysexecutive difficulty and subtle everyday functional disabilities: the digital Trail Making Test.

Background: Digital neuropsychological tests reliably capture real-time, process-based behavior that traditional paper/pencil tests cannot detect, enabling earlier detection of neurodegenerative illness. We assessed relations between informant-based subtle and mild functional decline and process-based features extracted from the digital Trail Making Test-Part B (dTMT-B). Methods: A total of 321 community-dwelling participants (56.0% female) were assessed with the Functional Activities Questionnaire (FAQ) and the dTMT-B. Three FAQ groups were constructed: FAQ = 0 (unimpaired); FAQ = 1-4 (subtle impairment); FAQ = 5-8 (mild impairment). Results: Compared to the FAQ-unimpaired group, other groups required longer pauses inside target circles (p < 0.050) and produced more total pen strokes to complete the test (p < 0.016). FAQ-subtle participants required more time to complete the entire test (p < 0.002) and drew individual lines connecting successive target circles slower (p < 0.001) than FAQ-unimpaired participants. Lines connecting successive circle targets were less straight among FAQ-mild, compared to FAQ-unimpaired participants (p < 0.044). Using stepwise nominal regression (reference group = FAQ-unimpaired), pauses inside target circles classified other participants into their respective groups (p < 0.015, respectively). Factor analysis using six dTMT-B variables (oblique rotation) yielded a two-factor solution related to impaired motor/cognitive operations (48.96% variance explained) and faster more efficient motor/cognitive operations (28.88% variance explained). Conclusion: Digital assessment technology elegantly quantifies occult, nuanced behavior not previously appreciated, operationally defines critical underlying neurocognitive constructs related to functional abilities, and yields selected process-based scores that outperform traditional paper/pencil test scores for participant classification. When brought to scale, the dTMT-B test could be a sensitive tool to detect subtle-to-mild functional deficits in emergent neurodegenerative illnesses.

A Network Analysis of Digital Clock Drawing for Command and Copy Conditions.

Graphomotor and time-based variables from the digital Clock Drawing Test (dCDT) characterize cognitive functions. However, no prior publications have quantified the strength of the associations between digital clock variables as they are produced. We hypothesized that analysis of the production of clock features and their interrelationships, as suggested, will differ between the command and copy test conditions. Older adults aged 65+ completed a digital clock drawing to command and copy conditions. Using a Bayesian hill-climbing algorithm and bootstrapping (10,000 samples), we derived directed acyclic graphs (DAGs) to examine network structure for command and copy dCDT variables. Although the command condition showed moderate associations between variables (µ|ßz|= 0.34) relative to the copy condition (µ|ßz| = 0.25), the copy condition network had more connections (18/18 versus 15/18 command). Network connectivity across command and copy was most influenced by five of the 18 variables. The direction of dependencies followed the order of instructions better in the command condition network. Digitally acquired clock variables relate to one another but differ in network structure when derived from command or copy conditions. Continued analyses of clock drawing production should improve understanding of quintessential normal features to aid in early neurodegenerative disease detection.

A Chronic Increase in Blood-Brain Barrier Permeability Facilitates Intraneuronal Deposition of Exogenous Bloodborne Amyloid-Beta1-42 Peptide in the Brain and Leads to Alzheimer's Disease-Relevant Cognitive Changes in a Mouse Model.

Background: Increased blood-brain barrier (BBB) permeability and amyloid-ß (Aß) peptides (especially Aß1-42) (Aß42) have been linked to Alzheimer's disease (AD) pathogenesis, but the nature of their involvement in AD-related neuropathological changes leading to cognitive changes remains poorly understood. Objective: To test the hypothesis that chronic extravasation of bloodborne Aß42 peptide and brain-reactive autoantibodies and their entry into the brain parenchyma via a permeable BBB contribute to AD-related pathological changes and cognitive changes in a mouse model. Methods: The BBB was rendered chronically permeable through repeated injections of Pertussis toxin (PT), and soluble monomeric, fluorescein isothiocyanate (FITC)-labeled or unlabeled Aß42 was injected into the tail-vein of 10-month-old male CD1 mice at designated intervals spanning ∼3 months. Acquisition of learned behaviors and long-term retention were assessed via a battery of cognitive and behavioral tests and linked to neuropathological changes. Results: Mice injected with both PT and Aß42 demonstrated a preferential deficit in the capacity for long-term retention and an increased susceptibility to interference in selective attention compared to mice exposed to PT or saline only. Immunohistochemical analyses revealed increased BBB permeability and entry of bloodborne Aß42 and immunoglobulin G (IgG) into the brain parenchyma, selective neuronal binding of IgG and neuronal accumulation of Aß42 in animals injected with both PT and Aß42 compared to controls. Conclusion: Results highlight the potential synergistic role of BBB compromise and the influx of bloodborne Aß42 into the brain in both the initiation and progression of neuropathologic and cognitive changes associated with AD.

Comparing Cognitive Tests and Smartphone-Based Assessment in 2 US Community-Based Cohorts.

BACKGROUND: Smartphone-based cognitive assessments have emerged as promising tools, bridging gaps in accessibility and reducing bias in Alzheimer disease and related dementia research. However, their congruence with traditional neuropsychological tests and usefulness in diverse cohorts remain underexplored. METHODS AND RESULTS: A total of 406 FHS (Framingham Heart Study) and 59 BHS (Bogalusa Heart Study) participants with traditional neuropsychological tests and digital assessments using the Defense Automated Neurocognitive Assessment (DANA) smartphone protocol were included. Regression models investigated associations between DANA task digital measures and a neuropsychological global cognitive Z score (Global Cognitive Score [GCS]), and neuropsychological domain-specific Z scores. FHS participants' mean age was 57 (SD, 9.75) years, and 44% (179) were men. BHS participants' mean age was 49 (4.4) years, and 28% (16) were men. Participants in both cohorts with the lowest neuropsychological performance (lowest quartile, GCS1) demonstrated lower DANA digital scores. In the FHS, GCS1 participants had slower average response times and decreased cognitive efficiency scores in all DANA tasks (P<0.05). In BHS, participants in GCS1 had slower average response times and decreased cognitive efficiency scores for DANA Code Substitution and Go/No-Go tasks, although this was not statistically significant. In both cohorts, GCS was significantly associated with DANA tasks, such that higher GCS correlated with faster average response times (P<0.05) and increased cognitive efficiency (all P<0.05) in the DANA Code Substitution task. CONCLUSIONS: Our findings demonstrate that smartphone-based cognitive assessments exhibit concurrent validity with a composite measure of traditional neuropsychological tests. This supports the potential of using smartphone-based assessments in cognitive screening across diverse populations and the scalability of digital assessments to community-dwelling individuals.