Exploration of Eye-Tracking Methodologies in Usability Testing of Digital Health Technology: A Rapid Review.

Eye-tracking is deemed a promising methodology for usability evaluation studies in healthcare, however clear theoretical guidance and practice remains lacking. A rapid review was performed on current use of eye tracking as a usability evaluation method on digital health technologies in the period of 2019 to 2024. Usability evaluation studies were included when they described a digital health technology intervention in which eye-tracking technologies were applied. To gain insight into how eye-tracking technologies contributed to measuring digital health technologies' usability, data was extracted on the use of eye-tracking for usability and key study findings. Seventeen papers were included in the review. Findings show that eye-tracking is frequently combined with other usability evaluation methods, with high methodological diversity, to test the usability of DHT. Future research is needed to enhance understanding of the effectiveness of eye-tracking outcomes in DHT usability testing when combined with other usability evaluation methods in order to provide (usability) researchers theoretical guidance on its application.

From Theory to Practice: Practical Applications of the MOLD-US Framework.

The MOLD-US framework has been developed to synthesize knowledge for (usability) researchers on aging- and disease-related barriers that can hamper the use of health information technology (HIT). However, dissemination in terms of practical applications of the framework is currently unknown and could inform industry and researchers for applying MOLD-US in practice, but also provide insights on the use of theoretical frameworks in HIT research. Therefore, a citation analysis was conducted on the paper presenting the MOLD-US framework. Nine of the 241 citations were found to report practical application(s) of the MOLD-US framework in their methods section: (1) qualitative research input (n=3), (2) research design (n=3), (3) design approaches (n=2), and (4) conceptual framework development (n=2). Future work aims to explore MOLDUS-US practical applications in the industry, through for example grey literature, but also continuously monitor novel applications to enhance the development of HIT for the aging population.

Capturing Usability Problems for People Living With Dementia by Applying the DEMIGNED Principles in Usability Evaluation Methods: Mixed Methods Study.

BACKGROUND: Dementia-related impairments can cause complex barriers to access, use, and adopt digital health technologies (DHTs). These barriers can contribute to digital health inequities. Therefore, literature-based design principles called DEMIGNED have been developed to support the design and evaluation of DHTs for this rapidly increasing population. OBJECTIVE: This study aims to apply the DEMIGNED principles in usability evaluation methods to (1) capture usability problems on a mobile website providing information resources for people visiting a memory clinic, including those living with subjective cognitive decline (SCD), mild cognitive impairment (MCI), or dementia, and (2) investigate the realness of usability problems captured by the DEMIGNED principles in expert testing, specifically for mobile websites that act as a means of providing DHTs. METHODS: First, a heuristic evaluation was conducted, with the DEMIGNED principles serving as domain-specific guidelines, with 3 double experts (experienced in both usability and dementia) and 2 usability engineering experts. Second, think-aloud sessions were conducted with patients visiting a memory clinic who were living with SCD, MCI, or dementia. RESULTS: The heuristic evaluation resulted in 36 unique usability problems. A representative sample of 7 people visiting a memory clinic participated in a think-aloud session, including 4 (57%) with SCD, 1 (14%) with MCI, and 2 (29%) with dementia. The analysis of the think-aloud sessions revealed 181 encounters with usability problems. Of these encounters, 144 (79.6%) could be mapped to 18 usability problems identified in the heuristic evaluation. The remaining 37 (20.4%) encounters from the user testing revealed another 10 unique usability problems. Usability problems frequently described in the think-aloud sessions encompassed difficulties with using the search function, discrepancies between the user's expectations and the content organization, the need for scrolling, information overload, and unclear system feedback. CONCLUSIONS: By applying the DEMIGNED principles in expert testing, evaluators were able to capture 79.6% (144/181) of all usability problem encounters in the user testing of a mobile website for people visiting a memory clinic, including people living with dementia. Regarding unique usability problems, 50% (18/36) of the unique usability problems identified during the heuristic evaluation were captured by the user-testing sessions. Future research should look into the applicability of the DEMIGNED principles to other digital health functionalities to increase the accessibility of digital health and decrease digital health inequity for this complex and rapidly increasing population.

Proposing a Novel Hybrid Short-Term Exchange Program in Biomedical and Health Informatics Education.

International student exchange is a valuable opportunity for Biomedical and Health Informatics students to gain new perspectives and experiences. In the past, such exchanges have been made possible through international partnerships between universities. Unfortunately, numerous obstacles such as housing, financial concerns, and environmental implications related to travel, have made it difficult to continue international exchange. Experiences with hybrid and online education during covid-19 paved the way for a new approach that allows for short international exchange with a hybrid online-offline supervision model. This will be initiated with an exploration project between two international universities , each related to their respective institute's research focus.

Enhancing Inclusive mHealth Design for People Living with Dementia: Examples from Literature.

The availability of mHealth technologies for older adults living with dementia is increasing. However, due to highly complex and varying clinical presentations of dementia, these technologies do not always meet their needs, wishes and capabilities. An exploratory literature review was performed to identify studies that applied evidence-based design principles or provide design choices that aim to improve mHealth design. These were categorized as a unique design choice to tackle barriers to mHealth use related to cognition, perception, physical ability, frame of mind, or speech- and language. Through thematic analysis, themes of design choices were summarized per category in the MOLDEM-US framework. Thirty-six studies were included for data extraction, leading to seventeen categories of design choices. This study pushes the need to further investigate and refine inclusive mHealth design solutions for populations with highly complex symptoms, such as those living with dementia.

Expert appraisal and prioritization of barriers to mHealth use for older adults living with Alzheimer's disease and related Dementias: A Delphi study.

INTRODUCTION: Older adults living with Alzheimer's disease and related dementias (ADRD) can benefit from mHealth innovations in (daily) care. However, successful implementation and adoption of such innovations can be hindered by a lack of inclusive design. Inclusive design can be challenging, due to the variety of ADRD- and aging-related symptoms that can pose barriers to using mHealth. Previously, a literature-based model with 53 barriers to mHealth use for this population has been developed ("MHealth for OLder adults living with DEMentia - USability" or MOLDEM-US). In this study, we aim to prioritize these through a Delphi study with ADRD experts (case managers, informal caregivers, hospital healthcare professionals, district nurses, and researchers). METHODS: In the first round, participant characteristics and potentially new insights into barriers to mHealth use for older adults living with ADRD were gathered. The consensus questionnaire was submitted in the second round, containing barriers to mHealth use for this population (from MOLDEM-US) with questions inquiring its impact and frequency. In the third round, participants rejudged those barriers for which no consensus (<51 %) or minor consensus (51 % - 60 %) was reached. RESULTS: Thirty-seven participants completed the three rounds of the study. Consensus was reached for eleven barriers after the second round, all having major impact and frequency: integration of functions during daily activities, perceived complexity, efficiency in seeing benefits, trust in own ability, restlessness and agitation, computer literacy, self confidence in using wearables, learnability, working memory, and visual acuity. CONCLUSION: After round three, consensus was achieved for all 53 barriers. Twenty-six barriers are considered to majorly affect mHealth use, most of which relate to cognition and frame of mind. This study contributes to the development of mHealth design guidelines that take into account the progressive and diverse ADRD- and aging-related symptoms negatively affecting mHealth implementation and adoption.

Overcoming Challenges to Inclusive User-based Testing of Health Information Technology with Vulnerable Older Adults: Recommendations from a Human Factors Engineering Expert Inquiry.

OBJECTIVES: Involving representative users in usability testing of health information technology (HIT) is central to user-centered design. However, (vulnerable) older adults as representative users have unique requirements. Aging processes may affect physical capabilities and cognitive skills, which can hamper testing with this demographic and may require special attention and revised protocols. This study was performed to provide expert-based recommendations for HIT user-testing with (vulnerable) older adults to support inclusive HIT design and evaluation. METHODS: First, we conducted a structured workshop with ten experts in HIT implementation and research, recruited through purposeful sampling, to generate insights into how characteristics of older adults may influence user-testing. Next, five Human Factor researchers experienced in HIT user-testing with (vulnerable) older adults validated the results and provided additional textual insights to gain consensus on the most important recommendations. A thematic analysis was performed on the resulting inquiries. Applied codes were based on the User-Centered Design framework. RESULTS: The analysis resulted in nine recommendations for user-testing of HIT with older adults, divided into three main themes: (1) empathetic approach and trust-building, (2) new requirements for testing and study design, and (3) adjustments to usability evaluation methods. For each theme a checklist of relevant items to follow-up on the recommendation is provided. CONCLUSIONS: The recommendations generated through expert inquiry contribute to more effective usability testing of HIT with older adults. This provides an important step towards improved accessibility of HIT amongst older adults through inclusive user-centered design.

Evaluating mHealth Design for People with Dementia: Preliminary Results.

The availability of mHealth for people with dementia is increasing. Various mHealth design guidelines for this population have been proposed. In this study, we developed a binary checklist with evaluation statements to assess the implementation of twenty design suggestions in seven currently available mHealth apps for people with dementia. Between 17%-65% of the evaluation statements in the checklist were implemented in these apps. Not all statements were considered applicable for each assessed mHealth app, which resulted in dividing the criteria in two groups as either key evaluation statements or optional evaluation statements. In future work we want to augment this checklist to contribute to the future design of mHealth for people with dementia.

Dementia-Related Barriers to mHealth Use: Validation by Expert Opinion.

mHealth use for people with dementia is fraught with factors influencing its implementation in care and daily life. A better understanding of these factors may provide guidelines to inclusive design. This study aimed to assess whether factors gathered in a literature-based model could be validated by opinions of experts. On basis of a questionnaire as part of a larger study, experts identified barriers that they considered to be related to aging and dementia influencing mHealth use. Nineteen barriers that were mentioned by the dementia experts were covered in our literature-based model. No adaptions to the model were required. The dementia experts acclaimed three barriers to mHealth use that could not be mapped onto the framework: the unavailability of (informal) caregivers to support the mHealth use, the stage and type of dementia of an mHealth user, and the fear of the unknown. These should be considered as prerequisites in the implementation phase of mHealth and explored more in future research.

Current mHealth Use in Dutch Dementia Care: A Guide to Action!

OBJECTIVE: To report underlying factors that hinder or advance mHealth implementation and use in Dutch dementia care. METHODS: 44 dementia experts (healthcare professionals, informal caregivers, dementia case managers, and researchers) completed a questionnaire as part of a wider Delphi study to share their experiences with, thoughts on, and proposals for mHealth use in Dutch dementia care. A SWOT-framework is used to categorize the experiences, thoughts and proposals. RESULTS: Four strengths, twelve weaknesses, thirteen opportunities and six threats for the current use of mHealth in Dutch dementia care were identified. CONCLUSION: Identified weaknesses highlight the importance for a guide for action for everyone involved in design and implementing mHealth for older adults with dementia. It is critical to raise awareness of mHealth's availability, improve its design, and continue to address the needs of older adults with dementia.

Considerate mHealth design for older adults with Alzheimer's disease and related dementias (ADRD): A scoping review on usability barriers and design suggestions.

BACKGROUND: The number of older adults with Alzheimer's disease and related dementias (ADRD) is increasing worldwide. This offers ample opportunities for mobile health (mHealth) apps, for example to support them in performing daily activities or monitoring their health status. However, how to design these apps taking into consideration ADRD related barriers remains a challenge. OBJECTIVE: To provide a synthesis of mHealth usability barriers of older adults with ADRD and design suggestions to enhance user-friendliness of mHealth apps. METHODS: We performed a scoping review of mHealth studies focused on older adults with ADRD and: (1) usability barriers experienced, and/or (2) implementation or design suggestions. PubMed, Medline, EMBASE, PsycINFO, and Web of Science were searched. Clinical and grey literature on ADRD diminishments was explored to identify potential barriers to using mHealth. Detected usability barriers caused by ADRD impairments were mapped onto the MOLD-US framework through validation, calibration, and adaption. MOLD-US was initially developed to provide an overview of barriers influencing mHealth usability for the general aging population. RESULTS: Title and abstract of 792 unique citations were scanned of which 69 were included for full text review. Fifteen studies matched inclusion criteria. In total 42 barriers were identified to influence mobile health use for older adults with ADRD. Twenty design suggestions were extracted from the studies. CONCLUSIONS: The identified usability barriers were classified in five categories: cognition, perception, physical ability, frame of mind, and speech- and language. In addition, the design suggestions were categorized as evidence- or expert-based. Evidence-based design suggestions include showing limited information, repeating instructions multiple times and breaking instructions into simple steps given one at a time. This research provides a first step for further collaboration between ADRD experts and designers to support the development of effective mHealth apps with high user-friendliness.

Best Practices for Designing Discrete Choice Experiments and the Use for Older Adults with Cognitive Impairment.

OBJECTIVE: the aim of this scoping review is to 1) identify guidelines, frameworks, issues, and recommendations regarding the development of a discrete choice experiment (DCE), 2) look at potential design considerations regarding the development of a DCE for older adults with dementia, and 3) summarize knowledge about the current inclusion of and experiences with older adults with cognitive impairment in DCE studies. METHODS: Two literature searches divided into two topics were performed in PubMed, CINAHL, and PsycINFO. RESULTS: Topic 1 found 19 articles regarding frameworks, guidelines and design considerations for DCEs in healthcare. Topic 2 found eight articles regarding the effect of cognitive impairment on DCE results and/or discussing the inclusion of cognitive impaired older adults in these DCE studies. CONCLUSION: There is minimal literature available regarding the effect of cognitive impairment on DCE results. In future studies we will explore if DCEs can be used to involve older adults with dementia in decisions regarding transitions in care.

Recruiting older adult participants through crowdsourcing platforms: Mechanical Turk versus Prolific Academic.

BACKGROUND: Recruiting older adults (OA) into research is challenging. OBJECTIVE: To assess the feasibility of using two crowdsourcing platforms, Amazon's Mechanical Turk (MTurk) and Prolific Academic (ProA), as efficient and low-cost venues for recruiting survey participants aged 65 and older. METHODS: We developed an online survey to investigate and compare the demographics, technology use, and motivations for research participation of OA on MTurk and ProA. Qualitative responses, response time, word count, and recruitment costs were analyzed. RESULTS: We recruited 97 OA survey participants on both MTurk and ProA. Participants were similar in terms ofdemographics, technology usage, and motivations for participation (topic interest and payment). CONCLUSION: Both crowdsourcing platforms are useful for rapid and low-cost recruitment of OA. The OA recruitment process was more efficient with ProA. Crowdsourcing platforms are potential sources of OA research participants; however, the pool is limited to generally healthy, technologically active, and well-educated older adults.