Assessing the Usability and Feasibility of Digital Assistant Tools for Direct Support Professionals: Participatory Design and Pilot-Testing.

BACKGROUND: The United States is experiencing a direct support professional (DSP) crisis, with demand far exceeding supply. Although generating documentation is a critical responsibility, it is one of the most wearisome aspects of DSPs' jobs. Technology that enables DSPs to log informal time-stamped notes throughout their shift could help reduce the burden of end-of-shift documentation and increase job satisfaction, which in turn could improve the quality of life of the individuals with intellectual and developmental disabilities (IDDs) whom DSPs support. However, DSPs, with varied ages, levels of education, and comfort using technology, are not likely to adopt tools that detract from caregiving responsibilities or increase workload; therefore, technological tools for them must be relatively simple, extremely intuitive, and provide highly valued capabilities. OBJECTIVE: This paper describes the development and pilot-testing of a digital assistant tool (DAT) that enables DSPs to create informal notes throughout their shifts and use these notes to facilitate end-of-shift documentation. The purpose of the pilot study was to assess the usability and feasibility of the DAT. METHODS: The research team applied an established user-centered participatory design process to design, develop, and test the DAT prototypes between May 2020 and April 2023. Pilot-testing entailed having 14 DSPs who support adults with IDDs use the first full implementation of the DAT prototypes during 2 or 3 successive work shifts and fill out demographic and usability questionnaires. RESULTS: Participants used the DAT prototypes to create notes and help generate end-of-shift reports. The System Usability Scale score of 81.79 indicates that they found the prototypes easy to use. Survey responses imply that using the DAT made it easier for participants to produce required documentation and suggest that they would adopt the DAT if this tool were available for daily use. CONCLUSIONS: Simple technologies such as the DAT prototypes, which enable DSPs to use mobile devices to log time-stamped notes throughout their shift with minimal effort and use the notes to help write reports, have the potential to both reduce the burden associated with producing documentation and enhance the quality (level of detail and accuracy) of this documentation. This could help to increase job satisfaction and reduce turnover in DSPs, both of which would help improve the quality of life of the individuals with IDDs whom they support. The pilot test results indicate that DSPs found the DAT easy to use. Next steps include (1) producing more robust versions of the DAT with additional capabilities, such as storing data locally on mobile devices when Wi-Fi is not available; and (2) eliciting input from agency directors, families, and others who use data about adults with IDDs to help care for them to ensure that data produced by DSPs are relevant and useful.

Neurocognitive Operations Underlying Working Memory Abilities: An Analysis of Latency and Time-Based Parameters.

BACKGROUND: The theory of executive attention (Fuster, 2015) suggests considerable plasticity regarding when specific neurocognitive operations are recruited to bring executive tasks to fruition. OBJECTIVE: We tested the hypothesis that differing neurocognitive operations are recruited upon the initiation of a response, but that other distinct neurocognitive operations are recruited towards the middle or end of a response. METHODS: The Backward Digit Span Test (BDST) was administered to 58 memory clinic patients (MCI, n = 22; no-MCI, n = 36). Latency to generate all correct 5-span responses was obtained. Statistical analyses found that optimal group classification was achieved using the first and third digit backward. First and third response latencies were analyzed in relation to verbal working memory (WM), visual WM, processing speed, visuospatial operations, naming/lexical access, and verbal episodic memory tests. RESULTS: For the first response, slower latencies were associated with better performance in relation to verbal WM and visuospatial test performance. For the third response, faster latencies were associated with better processing speed and visuospatial test performance. CONCLUSION: Consistent with the theory of executive attention, these data show that the neurocognitive operations underlying successful executive test performance are not monolithic but can be quite nuanced with differing neurocognitive operations associated with specific time epochs. Results support the efficacy of obtaining time-based latency parameters to help disambiguate successful executive neurocognitive operations in memory clinic patients.

The Boston Process Approach and Digital Neuropsychological Assessment: Past Research and Future Directions.

Neuropsychological assessment using the Boston Process Approach (BPA) suggests that an analysis of the strategy or the process by which tasks and neuropsychological tests are completed, and the errors made during test completion convey much information regarding underlying brain and cognition and are as important as overall summary scores. Research over the last several decades employing an analysis of process and errors has been able to dissociate between dementia patients diagnosed with Alzheimer's disease, vascular dementia associated with MRI-determined white matter alterations, and Parkinson's disease; and between mild cognitive impairment subtypes. Nonetheless, BPA methods can be labor intensive to deploy. However, the recent availability of digital platforms for neuropsychological test administration and scoring now enables reliable, rapid, and objective data collection. Further, digital technology can quantify highly nuanced data previously unobtainable to define neurocognitive constructs with high accuracy. In this paper, a brief review of the BPA is provided. Studies that demonstrate how digital technology translates BPA into specific neurocognitive constructs using the Clock Drawing Test, Backward Digit Span Test, and a Digital Pointing Span Test are described. Implications for using data driven artificial intelligence-supported analytic approaches enabling the creation of more sensitive and specific detection/diagnostic algorithms for putative neurodegenerative illness are also discussed.

Digital Neuropsychological Assessment: New Technology for Measuring Subtle Neuropsychological Behavior.

Technology has transformed the science and practice of medicine. In this special mini-forum, data using digital neuropsychological technology are reported. All of these papers demonstrate how coupling digital technology with standard paper and pencil neuropsychological tests are able to extract behavior not otherwise obtainable. As digital assessment methods mature, early identification of persons with emergent neurodegenerative and other neurological illness may be possible.

Neurocognitive Constructs Underlying Executive Control in Statistically-Determined Mild Cognitive Impairment.

BACKGROUND: The model of executive attention proposes that temporal organization, i.e., the time necessary to bring novel tasks to fruition is an important construct that modulates executive control. Subordinate to temporal organization are the constructs of working memory, preparatory set, and inhibitory control. OBJECTIVE: The current research operationally-defined the constructs underlying the theory of executive attention using intra-component latencies (i.e., reaction times) from a 5-span backward digit test from patients with suspected mild cognitive impairment (MCI). METHODS: An iPad-version of the Backward Digit Span Test (BDT) was administered to memory clinic patients. Patients with (n = 22) and without (n = 36) MCI were classified. Outcome variables included intra-component latencies for all correct 5-span serial order responses. RESULTS: Average total time did not differ. A significant 2-group by 5-serial order latency interaction revealed the existence of distinct time epochs. Non-MCI patients produced slower latencies on initial (position 2-working memory/preparatory set) and latter (position 4-inhibitory control) correct serial order responses. By contrast, patients with MCI produced a slower latency for middle serial order responses (i.e., position 3-preparatory set). No group differences were obtained for incorrect 5-span test trials. CONCLUSION: The analysis of 5-span BDT serial order latencies found distinct epochs regarding how time was allocated in the context of successful test performance. Intra-component latencies obtained from tests assessing mental re-ordering may constitute useful neurocognitive biomarkers for emergent neurodegenerative illness.