Device-Embedded Cameras for Eye Tracking-Based Cognitive Assessment: Implications for Teleneuropsychology.

Introduction:Widespread screening for cognitive decline is an important challenge to address as the aging population grows, but there is currently a shortage of clinical infrastructure to meet the demand for in-person evaluation. Remotely delivered assessments that utilize eye-tracking data from webcams, such as visual paired comparison (VPC) tasks, could increase access to remote, asynchronous neuropsychological screening for cognitive decline but further validation against clinical-grade eye trackers is required.Methods:To demonstrate equivalence between a novel automated scoring system for eye-tracking metrics acquired through a laptop-embedded camera and a gold-standard eye tracker, we analyzed VPC data from 18 subjects aged 50+ with normal cognitive function across three visits. The eye tracker data were scored by the manufacturer's software, and the webcam data were scored by a novel algorithm.Results:Automated scoring of webcam-based VPC data revealed strong correlations with the clinical-grade eye-tracking camera. Correlation of mean VPC performance across all time points was robust: r = 0.95 (T1 r = 0.97; T2 r = 0.88; T3 r = 0.97; p's < 0.001). Correlation of per-trial performance across time points was also robust: r = 0.88 (T1 r = 0.85; T2 r = 0.89; T3 r = 0.92; p's < 0.001). Mean differences between performance data acquired by each device were 0.00.Conclusion:These results suggest that device-embedded cameras are a valid and scalable alternative to traditional laboratory-based equipment for gaze-based tasks measuring cognitive function. The validation of this technique represents an important technical advance for the field of teleneuropsychology.

Device-Embedded Cameras for Eye Tracking-Based Cognitive Assessment: Validation With Paper-Pencil and Computerized Cognitive Composites.

BACKGROUND: As eye tracking-based assessment of cognition becomes more widely used in older adults, particularly those at risk for dementia, reliable and scalable methods to collect high-quality data are required. Eye tracking-based cognitive tests that utilize device-embedded cameras have the potential to reach large numbers of people as a screening tool for preclinical cognitive decline. However, to fully validate this approach, more empirical evidence about the comparability of eyetracking-based paradigms to existing cognitive batteries is needed. OBJECTIVE: Using a population of clinically normal older adults, we examined the relationship between a 30-minute Visual Paired Comparison (VPC) recognition memory task and cognitive composite indices sensitive to a subtle decline in domains associated with Alzheimer disease. Additionally, the scoring accuracy between software used with a commercial grade eye tracking camera at 60 frames per second (FPS) and a manually scored procedure used with a laptop-embedded web camera (3 FPS) on the VPC task was compared, as well as the relationship between VPC task performance and domain-specific cognitive function. METHODS: A group of 49 clinically normal older adults completed a 30-min VPC recognition memory task with simultaneous recording of eye movements by a commercial-grade eye-tracking camera and a laptop-embedded camera. Relationships between webcam VPC performance and the Preclinical Alzheimer Cognitive Composite (PACC) and National Institutes of Health Toolbox Cognitive Battery (NIHTB-CB) were examined. Inter-rater reliability for manually scored tests was analyzed using Krippendorff's kappa formula, and we used Spearman's Rho correlations to investigate the relationship between VPC performance scores with both cameras. We also examined the relationship between VPC performance with the device-embedded camera and domain-specific cognitive performance. RESULTS: Modest relationships were seen between mean VPC novelty preference and the PACC (r=.39, P=.007) and NIHTB-CB (r=.35, P=.03) composite scores, and additional individual neurocognitive task scores including letter fluency (r=.33, P=.02), category fluency (r=.36, P=.01), and Trail Making Test A (-.40, P=.006). Robust relationships were observed between the 60 FPS eye tracker and 3 FPS webcam on both trial-level VPC novelty preference (r=.82, P<.001) and overall mean VPC novelty preference (r=.92 P<.001). Inter-rater agreement of manually scored web camera data was high (kappa=.84). CONCLUSIONS: In a sample of clinically normal older adults, performance on a 30-minute VPC task correlated modestly with computerized and paper-pencil based cognitive composites that serve as preclinical Alzheimer disease cognitive indices. The strength of these relationships did not differ between camera devices. We suggest that using a device-embedded camera is a reliable and valid way to assess performance on VPC tasks accurately and that these tasks correlate with existing cognitive composites.