Translating a motivational interviewing intervention for childhood cancer survivors into an eHealth tool: A user-centered design process.

Childhood cancer survivors have a higher risk of developing cardiomyopathy than members of the general population. Screening echocardiograms can facilitate early detection and treatment of cardiomyopathy. Furthermore, motivational interviewing can increase uptake of cardiac screening. However, such approaches are time- and resource-intensive, which limits their reach to the survivors who need them. We describe how we utilized a user-centered design process to translate an in-person motivational interviewing intervention into an eHealth tool to improve cardiac screening among childhood cancer survivors. We used an iterative, three-phase, user-centered design approach: (i) setting the stage (convening advisory boards and reviewing the original intervention), (ii) content programming and development (writing and programming intervention text and flow), and (iii) intervention testing (research team testing and cognitive interviews.) For cognitive interviews, participants were recruited via institutional participant registries and medical records. Data were analyzed using rapid qualitative analysis. During Phase 1, we identified survivor and provider advisors and outlined elements of the in-person intervention to change for the eHealth tool. During Phases 2 and 3, advisors recommended several modifications that guided the final intervention content and flow. Examples include: acknowledging potential hesitation or apprehension surrounding medical screenings, addressing barriers and facilitators to obtaining screening, and improving the tool's usability and appeal. In Phase 3, cognitive interview participants suggested additional refinements to the intervention language. This translation process shows that continued in-depth engagement of community advisors and iterative testing can improve the applicability of an eHealth to survivors' lived experiences and social contexts.

Childhood cancer survivors have a higher-than-average risk for developing heart damage compared to the general population. One-on-one interviews aimed at educating survivors about the importance of screening for heart damage can increase engagement in screening, but these programs are often too resource-intensive to be made available to large groups of survivors. Programs delivered using digital technology, like websites and smartphone apps, can be a more accessible alternative. In this article, we describe how we translated an in-person counseling program into a digital tool. We convened advisors who were childhood cancer survivors and healthcare providers to review the tool throughout the three-phase translation process: (i) setting the stage (convening advisory boards and reviewing original intervention), (ii) content programming and development (writing, and programming intervention text and flow), and (iii) intervention testing (research team testing and cognitive interviews.). Our translation process shows that continuously engaging with advisory boards and testing apps with participants can improve health programs in line with communities' diverse perspectives.

Weight management personas of breast cancer patients undergoing chemotherapy in China: a multi-method study.

BACKGROUND: Mobile health (mHealth) may be an ideal solution for breast cancer (BC) patients in China to access weight management interventions. User retention and engagement are the main challenges faced by mHealth applications. A user persona, which is a user-centered design process, can lead to the development of mHealth that is more acceptable to the needs of target users. This study aimed to investigate the variety of experiences in weight management and the behavioral preferences of BC patients receiving chemotherapy to develop users' personal information and persona development for the design and implementation of mHealth interventions. METHODS: Sixteen individual semi-structured in-depth interviews were conducted with BC patients receiving chemotherapy. We employed the thematic analysis method to analyze the interview transcripts in NVivo 11 software. The themes obtained from the analysis were used as the subdomains of personas. A proforma was designed to extract each participant's experience in each subdomain. Patients who exhibited similar experience in subdomains were grouped into a persona using affinity diagrams. The personas were named according to their prominent features. A questionnaire survey was conducted to validate the personas and to test whether the personas that were generated from the qualitative interview data were applicable to the Chinese population with BC. RESULTS: Four themes were identified as subdomains of weight management personas: the perception of weight management while undergoing chemotherapy, symptoms and emotional disturbance, changes in diet and exercise, and health literacy and information seeking. Five personas were ultimately obtained: (1) positive weight controllers, (2) patients who were inactive due to fatigue, (3) young patients who avoided communication, (4) overweight patients with treatment priority, and (5) patients who engaged in irregular exercise. Finally, the quantitative study showed that 51.58% of patients chose one of these five personas to represent themselves in weight management. None of the patient reported selecting options that were not explicitly outlined in the questionnaire and provided personalized descriptions of their weight management characteristics. CONCLUSIONS: The selected personas were developed from in-depth interviews on biopsychosocial areas. They highlight different weight management patterns in Chinese BC patients and provide implications for both the design of mHealth systems and traditional interventions.

Evaluating the Usability of an mHealth App for Empowering Cancer Survivors With Disabilities: Heuristic Evaluation and Usability Testing.

BACKGROUND: More than 18 million cancer survivors are living in the United States. The effects of cancer and its treatments can have cognitive, psychological, physical, and social consequences that many survivors find incredibly disabling. Posttreatment support is often unavailable or underused, especially for survivors living with disabilities. This leaves them to deal with new obstacles and struggles on their own, oftentimes feeling lost during this transition. Mobile health (mHealth) interventions have been shown to effectively aid cancer survivors in dealing with many of the aftereffects of cancer and its treatments; these interventions hold immense potential for survivors living with disabilities. We developed a prototype for WeCanManage, an mHealth-delivered self-management intervention to empower cancer survivors living with disabilities through problem-solving, mindfulness, and self-advocacy training. OBJECTIVE: Our study conducted a heuristic evaluation of the WeCanManage high-fidelity prototype and assessed its usability among cancer survivors with known disabilities. METHODS: We evaluated the prototype using Nielsen's 10 principles of heuristic evaluation with 22 human-computer interaction university students. On the basis of the heuristic evaluation findings, we modified the prototype and conducted usability testing on 10 cancer survivors with a variety of known disabilities, examining effectiveness, efficiency, usability, and satisfaction, including a completion of the modified System Usability Scale (SUS). RESULTS: The findings from the heuristic evaluation were mostly favorable, highlighting the need for a help guide, addressing accessibility concerns, and enhancing the navigation experience. After usability testing, the average SUS score was 81, indicating a good-excellent design. The participants in the usability testing sample expressed positive reactions toward the app's design, educational content and videos, and the available means of connecting with others. They identified areas for improvement, such as improving accessibility, simplifying navigation within the community forums, and providing a more convenient method to access the help guide. CONCLUSIONS: Overall, usability testing showed positive results for the design of WeCanManage. The course content and features helped participants feel heard, understood, and less alone.

A qualitative analysis of algorithm-based decision support usability testing for symptom management across the trajectory of cancer care: one size does not fit all.

BACKGROUND: Adults with cancer experience symptoms that change across the disease trajectory. Due to the distress and cost associated with uncontrolled symptoms, improving symptom management is an important component of quality cancer care. Clinical decision support (CDS) is a promising strategy to integrate clinical practice guideline (CPG)-based symptom management recommendations at the point of care. METHODS: The objectives of this project were to develop and evaluate the usability of two symptom management algorithms (constipation and fatigue) across the trajectory of cancer care in patients with active disease treated in comprehensive or community cancer care settings to surveillance of cancer survivors in primary care practices. A modified ADAPTE process was used to develop algorithms based on national CPGs. Usability testing involved semi-structured interviews with clinicians from varied care settings, including comprehensive and community cancer centers, and primary care. The transcripts were analyzed with MAXQDA using Braun and Clarke's thematic analysis method. A cross tabs analysis was also performed to assess the prevalence of themes and subthemes by cancer care setting. RESULTS: A total of 17 clinicians (physicians, nurse practitioners, and physician assistants) were interviewed for usability testing. Three main themes emerged: (1) Algorithms as useful, (2) Symptom management differences, and (3) Different target end-users. The cross-tabs analysis demonstrated differences among care trajectories and settings that originated in the Symptom management differences theme. The sub-themes of "Differences between diseases" and "Differences between care trajectories" originated from participants working in a comprehensive cancer center, which tends to be disease-specific locations for patients on active treatment. Meanwhile, participants from primary care identified the sub-theme of "Differences in settings," indicating that symptom management strategies are care setting specific. CONCLUSIONS: While CDS can help promote evidence-based symptom management, systems providing care recommendations need to be specifically developed to fit patient characteristics and clinical context. Findings suggest that one set of algorithms will not be applicable throughout the entire cancer trajectory. Unique CDS for symptom management will be needed for patients who are cancer survivors being followed in primary care settings.

User-Centered Design and Usability of a Culturally Adapted Virtual Survivorship Care App for Chinese Canadian Prostate Cancer Survivors: Qualitative Descriptive Study.

BACKGROUND: Cultural adaptations of digital health innovations are a growing field. However, digital health innovations can increase health inequities. While completing exploratory work for the cultural adaptation of the Ned Clinic virtual survivorship app, we identified structural considerations that provided a space to design digitally connected and collective care. OBJECTIVE: This study used a community-based participatory research and user-centered design process to develop a cultural adaptation of the Ned Clinic app while designing to intervene in structural inequities. METHODS: The design process included primary data collection and qualitative analysis to explore and distill design principles, an iterative design phase with a multidisciplinary team, and a final evaluation phase with participants throughout the design process as a form of member checking and validation. RESULTS: Participants indicated that they found the final adapted prototype to be acceptable, appropriate, and feasible for their use. The changes made to adapt the prototype were not specifically culturally Chinese. Instead, we identified ways to strengthen connections between the survivor and their providers; improve accessibility to resources; and honor participants' desires for relationality, accountability, and care. CONCLUSIONS: We grounded the use of user-centered design to develop a prototype design that supports the acts of caring through digital technology by identifying and designing to resist structures that create health inequities in the lives of this community of survivors. By designing for collective justice, we can provide accessible, feasible, and relational care with digital health through the application of Indigenous and Black feminist ways of being and knowing.

Development and usability testing of an electronic patient-reported outcome (ePRO) solution for patients with inflammatory diseases in an Advanced Therapy Medicinal Product (ATMP) basket trial.

BACKGROUND: Electronic patient-reported outcome (ePRO) systems are increasingly used in clinical trials to provide evidence of efficacy and tolerability of treatment from the patient perspective. The aim of this study is twofold: (1) to describe how we developed an electronic platform for patients to report their symptoms, and (2) to develop and undertake usability testing of an ePRO solution for use in a study of cell therapy seeking to provide early evidence of efficacy and tolerability of treatment and test the feasibility of the system for use in later phase studies. METHODS: An ePRO system was designed to be used in a single arm, multi-centre, phase II basket trial investigating the safety and activity of the use of ORBCEL-C™ in the treatment of patients with inflammatory conditions. ORBCEL-C™ is an enriched Mesenchymal Stromal Cells product isolated from human umbilical cord tissue using CD362+ cell selection. Usability testing sessions were conducted using cognitive interviews and the 'Think Aloud' method with patient advisory group members and Research Nurses to assess the usability of the system. RESULTS: Nine patient partners and seven research nurses took part in one usability testing session. Measures of fatigue and health-related quality of life, the PRO-CTCAE™ and FACT-GP5 global tolerability question were included in the ePRO system. Alert notifications to the clinical team were triggered by PRO-CTCAE™ and FACT-GP5 scores. Patient participants liked the simplicity and responsiveness of the patient-facing app. Two patients were unable to complete the testing session, due to technical issues. Research Nurses suggested minor modifications to improve functionality and the layout of the clinician dashboard and the training materials. CONCLUSION: By testing the effectiveness, efficiency, and satisfaction of our novel ePRO system (PROmicsR), we learnt that most people with an inflammatory condition found it easy to report their symptoms using an app on their own device. Their experiences using the PROmicsR ePRO system within a trial environment will be further explored in our upcoming feasibility testing. Research nurses were also positive and found the clinical dashboard easy-to-use. Using ePROs in early phase trials is important in order to provide evidence of therapeutic responses and tolerability, increase the evidence based, and inform methodology development. TRIAL REGISTRATION: ISRCTN, ISRCTN80103507. Registered 01 April 2022, https://www.isrctn.com/ISRCTN80103507.

More and more patients tell clinicians how they feel by completing questionnaires electronically. Therefore, it is important to assess how easy it is for patients to do this. In this study, we describe how we developed an electronic platform for patients to report their symptoms and how we tested the usability of this platform with patient partners and research nurses. Once the electronic platform was developed, quality of life and symptoms questionnaires were programmed onto it. Alerts were sent to the clinical team if specific scores were obtained on the symptoms questionnaires. Although two patient partners were not able to finish the testing session because of technical issues, the ones who completed the session liked its simplicity and responsiveness. The research nurses also liked the system and only suggested minor modifications. Following this testing, we refined the electronic platform to test it further in a larger study which investigates the safety and use of a drug. We hope that thanks to this electronic platform, we will obtain useful information on the safety and efficacy of treatment.

Prototyping Process and Usability Testing of a Serious Game for Brazilian Children With Type 1 Diabetes.

This study aims to describe the prototype development and testing of a serious game designed for Brazilian children with diabetes. Following an approach of user-centered design, the researchers assessed game's preferences and diabetes learning needs to develop a Paper Prototype. The gameplay strategies included diabetes pathophysiology, self-care tasks, glycemic management, and food group learning. Diabetes and technology experts (n = 12) tested the prototype during audio-recorded sessions. Next, they answered a survey to evaluate the content, organization, presentation, and educational game aspects. The prototype showed a high content validity ratio (0.80), with three items not achieving the critical values (0.66). Experts recommended improving the game content and food illustrations. This evaluation contributed to the medium-fidelity prototype version, which after testing with diabetes experts (n = 12) achieved high content validity values (0.88). One item did not meet the critical values. Experts suggested increasing the options of outdoor activities and meals. Researchers also observed and video-recorded children with diabetes (n = 5) playing the game with satisfactory interaction. They considered the game enjoyable. The interdisciplinary team plays an important role guiding the designers in the use of theories and real needs of children. Prototypes are a low-cost usability and a successful method for evaluating games.

Chemo assist for children mobile health application to manage chemotherapy-related symptoms in acute leukemia in Indonesia: a user-centered design approach.

BACKGROUND: A mobile health (mHealth) application can encourage parents and pediatric patients to be involved in caring for their child's health condition by providing the ability to identify and actively manage chemotherapy-related symptoms in their child. Several monitoring systems available today are diverse in features and system basis. This study aimed to develop and trial the Chemo Assist for Children (CAC) mHealth application for symptom management in children with acute lymphoblastic leukemia (ALL). METHODS: In this study, the development of the CAC application went through multiple phases and methods. Study phases included: (1) development of the application's feature based on the need assessment, (2) creation of content of application based on literature review, (3) develop prototyping of CAC, (4) expert review and feedback on the application content, (5) usability testing by targeted end-user. RESULTS: Based on need assessment, it was determined that parents with leukemia children were interested in symptom management of chemotherapy and preferred mobile applications. Therefore, a mHealth application was designed to include features to identify symptoms and provide recommendation strategies to manage the symptom. Usability evaluation by end-user revealed that mHealth is a valid, accessible, and appropriate application for users. CONCLUSIONS: The CAC mHealth application developed can meet the needs of technology users to identify symptoms and manage chemotherapy-related symptoms in children with ALL. The CAC mHealth application can accommodate data not recorded at out-of-hospital care, increase the independence of symptom management, and improve communication between parents of children with ALL and health workers.

Development, Usability Testing, and Implementation Assessment of Cancer Related Infertility Score Predictor, an Online Cancer Related Infertility Risk Counseling Tool.

Purpose: Oncofertility counseling of female cancer patients lacks efficient access to tailored and valid infertility risk estimates to support shared decision-making on fertility preservation treatments. The objective was to develop, conduct user-centered design, and plan clinic-based implementation of the Cancer Related Infertility Score Predictor (CRISP), a web-based tool to support infertility risk counseling. Methods: Using a mixed methods design, literature review was undertaken to abstract data on infertility, primary ovarian insufficiency, and amenorrhea risks of common cancer treatments. The CRISP website was programmed to take user input about patient ages and cancer treatments and generate a risk summary. Using user experience methodology and semistructured interviews, usability testing and implementation assessment were conducted with 12 providers recruited from 5 medical centers in Southern California. Results: The web-based CRISP tool encompasses infertility risk data for 60 treatment regimens among 10 cancer types. Usability testing demonstrated that the tool is intuitive and informed minor modifications, including adding crowd-sourced submission of additional cancer treatments. Participants rated the tool as credible, advantageous over current provider methods to ascertain infertility risks, and useful for tailoring treatment planning and counseling patients. A key barrier was lack of information on some cancer treatments. Fit within clinical workflow was feasible, particularly with electronic health record integration. Conclusions: The novel, web-based CRISP tool is a feasible, acceptable, and appropriate tool to address provider knowledge gap about cancer related infertility risks and use for patient counseling. CRISP has significant potential to support tailored oncofertility counseling in the heterogeneous young cancer patient population.

One Website to Gather them All: Usability Testing of the New German SKin Cancer INFOrmation (SKINFO) Website-A Mixed-methods Approach.

Skin cancer patients increasingly search the internet to acquire disease-related information. However, information on the internet may be misleading. Recently, SKINFO has been launched, a website exclusively created for German-speaking skin cancer patients providing information as well as additional resources of verified quality. Here, we describe the results of the first usability test of SKINFO using a mixed-methods approach. Ten adult patients with skin cancer were recruited for usability testing in the skin cancer units of the University Hospitals of Erlangen and Dresden, Germany. Testing consisted of three different scenarios where patients were asked to find specific information on the SKINFO website guided by the think-aloud method. Descriptive analysis and content analyses were performed. All patients would recommend SKINFO and appreciated its content, design, and structure. Think-aloud analysis identified the topics layout, navigation, and content and structure which would benefit from refinement. Major criticism included the navigation through the website, and the desire for more specific information addressing patients' relatives and the latest, up-to-date information. Overall, usability testing showed that the unique web-based information platform has the potential to support patients coping with skin cancer and thus strengthen informed decision-making.

Development and Usability Testing of a System to Detect Adverse Events and Medical Mistakes.

Many inpatient hospital visits result in adverse events, and a disproportionate number of adverse events are thought to occur among vulnerable populations. The personal and financial costs of these events are significant at the individual, care team, and system levels. Existing methods for identifying adverse events, such as the Institute for Healthcare Improvement Global Trigger Tool, typically involve retroactive chart review to identify risks or triggers and then detailed review to determine whether and what type of harm occurred. These methods are limited in scalability and ability to prospectively identify triggers to enable intervention before an adverse event occurs. The purpose of this study was to gather usability feedback on a prototype of an informatics intervention based on the IHI method. The prototype electronic Global Trigger Tool collects and presents risk factors for adverse events. Six health professionals identified as potential users in clinical, quality improvement, and research roles were interviewed. Interviewees universally described insufficiencies of current methods for tracking adverse events and offered important information on desired future user interface features. A key next step will be to refine and integrate an electronic Global Trigger Tool system into standards-compliant electronic health record systems as a patient safety module.

Sistema Apoio à Revisão Sistemática (AReS): descrição de funcionalidades e avaliação de validade e usabilidade com exemplo de aplicação em fibrose cística / Systematic Review Support System (AReS): description of functionalities and evaluation of validity and usability with example application in cystic fibrosis

Introdução. As revisões sistemáticas permitem que a produção científica sobre um assunto específico seja agregada e resumida, entretanto, sua realização é árdua, principalmente nas etapas iniciais, sendo de grande utilidade a existência de ferramentas computacionais que automatizem ou semiautomatizem o trabalho manual de investigadores. Objetivo. Desenvolver e avaliar um sistema computacional para identificar referências duplicadas e auxiliar na fase de elegibilidade de estudos de revisão de literatura. Métodos. Estudo metodológico que apresenta o sistema web "Apoio à Revisão Sistemática" (AReS), versão 1.0, com ênfase na avaliação de validade da identificação de referências duplicadas e na avaliação de usabilidade. Na descrição de suas funcionalidades, foram simuladas as etapas iniciais de uma revisão sistemática com estudos sobre fibrose cística. Na avaliação de validade, realizou-se comparação de sensibilidade e especificidade dos sistemas AReS, EndNote® e Rayyan®, considerando-se como referência a seleção manual de duplicatas. Para o teste de usabilidade, estudantes de pós-graduação, voluntários, resolveram 21 tarefas utilizando o sistema AReS. Os dados observados foram registrados e permitiram a avaliação da conclusão das tarefas (eficácia) e do tempo necessário para conclusão de cada tarefa (eficiência); a usabilidade foi avaliada pelos participantes por meio do instrumento System Usability Scale (SUS). Resultados: O sistema AReS permite eliminar referências duplicadas e apresentar resumos na mesma tela que contém os critérios de elegibilidade, facilitando a identificação dos elegíveis. O sistema compara as decisões dos pesquisadores sobre a elegibilidade dos estudos, mostrando as divergências a serem resolvidas. Na avaliação de validade, o sistema AReS identificou maior proporção de verdadeiras duplicatas do que os sistemas EndNote® e Rayyan®, com valores de sensibilidade, especificidade e acurácia acima de 98%. A avaliação de usabilidade resultou em índice de conclusão das tarefas acima de 90%, conforme esperado, com tempo médio total de 55,1 minutos, quando o esperado era de no máximo 60 minutos, e nota média de usabilidade de 82,4 em escala de 0 a 100. Conclusão: O sistema AReS (versão 1.0) permite a eliminação acurada de referências duplicadas e auxilia na seleção de estudos na fase de elegibilidade em revisões de literatura. A eficácia, eficiência e o grau de usabilidade fornecido pelo instrumento SUS poderão ser melhorados a partir da incorporação de ajustes que foram identificados no teste de usabilidade.

Introduction. Systematic reviews enable the scientific output on a specific subject to be pooled and summarized, but this can be painstaking, especially in the early stage. Thus, computer-based tools which semi or fully automate the manual work of investigators can be of great utility. Objective. To develop and assess a computer-based system for identifying duplicate references and aiding the eligibility stage of literature review studies. Methods. A methodological study presenting the Systematic Review Support web-based System (AReS), version 1.0, with assessment of the validity of the identification of duplicate references and usability evaluation. In the description of its functionalities, the initial stages of a systematic review of studies on cystic fibrosis were simulated. For the assessment of validity, a comparison of the sensitivity and specificity of the AReS, EndNote® and Rayyan® systems was made, adopting manual screening for duplicates as a benchmark. For the test of usability, volunteer post-graduate students performed 21 tasks using the AReS system. The data observed were recorded, allowing an assessment of task completion (effectiveness) and time required to complete each task (efficiency); usability was rated by participants using the System Usability Scale (SUS). Results: The AReS system allowed removal of duplicate references; displayed the abstracts on the same screen as the eligibility criteria, aiding the identification of eligible abstracts. The system compared the decisions of the researchers regarding the eligibility of the studies, showing the differences to be resolved. On the validity assessment, the AReS identified a larger proportion of true duplicates than the EndNote® and Rayyan® systems tested, yielding sensitivity, specificity and accuracy values exceeding 98%. The evaluation of usability resulted in a task completion rate of over 90%, as expected, with a mean time of 55.1 minutes within a maximum expected time of 60 minutes, and usability score of 82.4 on a scale of 0 to 100. Conclusion: The AReS system (version 1.0) enabled accurate exclusion of duplicate references in literature reviews and aided the screening of studies in the eligibility stage. The effectiveness, efficiency and level of usability on the SUS can be further enhanced by incorporating tweaks identified in the usability tests.

Ten Steps to Design a Counseling App to Reduce the Psychosocial Impact of Human Papillomavirus Testing on the Basis of a User-Centered Design Approach in a Low- and Middle-Income Setting.

PURPOSE: This study describes the 10 steps followed to produce the information architecture of a user-centered design (UCD) counseling mobile application, the first phase to develop an app. The app aims to reduce the psychosocial impact of the human papillomavirus test result and improve women's knowledge of human papilloma virus and cervical cancer. METHODS: We used a UCD approach to produce the information architecture of the app (ie, how to organize contents into features). We analyzed field notes, meeting agendas, and documentation produced during each stage of the design process. We described the goals, methods, and outcomes of each step. We also discussed the critical challenges and the strategies to address them. RESULTS: The steps are (1) knowledge, attitudes, and beliefs mapping: reanalysis of team's research findings from prior studies; (2) environmental scanning of apps available on the market; (3) stakeholders' point of view: The International Advisory Committee; (4) potential user's profile: building archetypes through the Persona method; (5) women's interviews: user's preferences and experiences; (6) effective features: scoping review to select app's features that address psychosocial impact; (7) the user journey: ideal interaction with the gynecological service and the counseling app; (8) women's focus groups: using Personas and Scenarios to discuss app's mock-up; (9) women's design sessions: prototype test and card-sorting techniques; and (10) team's design session: translating results into visual objects and features. CONCLUSION: We provide here detailed descriptions of the UCD process of an app for human papillomavirus-tested women for those venturing into the area of mHealth strategies work. Our experience can be used as a guide for future mHealth app development for a low- and middle-income setting.

Development and usability testing of a chatbot to promote mental health services use among individuals with eating disorders following screening.

OBJECTIVE: A significant gap exists between those who need and those who receive care for eating disorders (EDs). Novel solutions are needed to encourage service use and address treatment barriers. This study developed and evaluated the usability of a chatbot designed for pairing with online ED screening. The tool aimed to promote mental health service utilization by improving motivation for treatment and self-efficacy among individuals with EDs. METHODS: A chatbot prototype, Alex, was designed using decision trees and theoretically-informed components: psychoeducation, motivational interviewing, personalized recommendations, and repeated administration. Usability testing was conducted over four iterative cycles, with user feedback informing refinements to the next iteration. Post-testing, participants (N= 21) completed the System Usability Scale (SUS), the Usefulness, Satisfaction, and Ease of Use Questionnaire (USE), and a semi-structured interview. RESULTS: Interview feedback detailed chatbot aspects participants enjoyed and aspects necessitating improvement. Feedback converged on four themes: user experience, chatbot qualities, chatbot content, and ease of use. Following refinements, users described Alex as humanlike, supportive, and encouraging. Content was perceived as novel and personally relevant. USE scores across domains were generally above average (~5 out of 7), and SUS scores indicated "good" to "excellent" usability across cycles, with the final iteration receiving the highest average score. DISCUSSION: Overall, participants generally reflected positively on interactions with Alex, including the initial version. Refinements between cycles further improved user experiences. This study provides preliminary evidence of the feasibility and acceptance of a chatbot designed to promote motivation for and use of services among individuals with EDs. PUBLIC SIGNIFICANCE: Low rates of service utilization and treatment have been observed among individuals following online eating disorder screening. Tools are needed, including scalable, digital options, that can be easily paired with screening, to improve motivation for addressing eating disorders and promote service utilization.

Combined Expert and User-Driven Usability Assessment of Trauma Decision Support Systems Improves User-Centered Design.

BACKGROUND: Trauma clinical decision support systems improve adherence with evidence-based practice but suffer from poor usability and the lack of a user-centered design. The objective of this study was to compare the effectiveness of user and expert-driven usability testing methods to detect usability issues in a rib fracture clinical decision support system and identify guiding principles for trauma clinical decision support systems. METHODS: A user-driven and expert-driven usability investigation was conducted using a clinical decision support system developed for patients with rib fractures. The user-driven usability evaluation was as follows: 10 clinicians were selected for simulation-based usability testing using snowball sampling, and each clinician completed 3 simulations using a video-conferencing platform. End-users participated in a novel team-based approach that simulated realistic clinical workflows. The expert-driven heuristic evaluation was as follows: 2 usability experts conducted a heuristic evaluation of the clinical decision support system using 10 common usability heuristics. Usability issues were identified, cataloged, and ranked for severity using a 4-level ordinal scale. Thematic analysis was utilized to categorize the identified usability issues. RESULTS: Seventy-nine usability issues were identified; 63% were identified by experts and 48% by end-users. Notably, 58% of severe usability issues were identified by experts alone. Only 11% of issues were identified by both methods. Five themes were identified that could guide the design of clinical decision support systems-transparency, functionality and integration into workflow, automated and noninterruptive, flexibility, and layout and appearance. Themes were preferentially identified by different methods. CONCLUSION: We found that a dual-method usability evaluation involving usability experts and end-users drastically improved detection of usability issues over single-method alone. We identified 5 themes to guide trauma clinical decision support system design. Performing usability testing via a remote video-conferencing platform facilitated multi-site involvement despite a global pandemic.

How to Retain Participants in User-Centered Design? Towards Recommendations for Minimizing Dropouts.

Dropout and fatigue is present in most research projects. The present project Chronic Pain includes Fibromyalgia patients and applies a user-centered design approach. Surprisingly to the research group, two years into the project there is zero dropout. As a step towards designing a survey to investigate the patient adherence to the project, the characteristics of the user-centered design process are described in this paper.

Making BRCA1 genetic test reports easier to understand through user-centered design: A randomized trial.

PURPOSE: Our objective was to apply a user-centered design process to identify phrases, graphics, and ways of communicating numerical risks that could be used to help patients understand their cancer risk and next steps on receiving BRCA1 genetic test results (positive, negative, and variants of uncertain significance). METHODS: The first phase of the study, a user-centered design process, consisted of 4 rounds of interviews (N = 42, including 13 health care professionals and 16 patients having undergone BRCA testing). The second was a randomized, between-participants experimental study of 456 United Kingdom residents that compared the resulting reports to reports used in a United Kingdom national genomic laboratory hub. Outcomes were subjective and objective comprehension, communication efficacy, actionability, and perceived risk. RESULTS: Subjective comprehension, communication efficacy, and actionability were all higher for the user-centered reports, with no difference in perceived risk. Comprehension of participants viewing user-centered reports was significantly better on 2 items, directionally (but not significantly) better on 6 items, and directionally (but not significantly) worse on 2 items. CONCLUSION: Our results imply that user-centered design is a promising approach for developing materials about complex genetic risks. We suggest wordings that are likely to lead to improved comprehension when communicating BRCA-associated risks.

A web-based comprehensive head and neck cancer patient education and support needs program: Usability testing.

Background: With increasing accessibility of the World Wide Web, patients are using it to obtain patient education materials (PEM). With this in mind, our group (surgeons, radiation oncologists, medical oncologists, nursing, allied health professionals and academic researchers) developed a comprehensive information resource for patients with head and neck cancer (HNC), the Head and Neck Cancer Australia, formerly Beyond Five website. The aim of this study was to determine patient usability of the Head and Neck Cancer Australia website. Methods: Usability testing (Cognitive walkthrough & Think-Aloud) in 18 patients treated for HNC was undertaken at a Cancer centre (anonymous for reviewers). Results: The tasks rated easiest by patients were finding information on psychological well-being (mean time spent: 66 s, range: 10-565), health and well-being effecting quality of life (mean time spent: 36 s, range 9-117) and carer information (mean time spent: 10 s, range 3-35). Patients indicated the website contained a lot of information, covers most topics, was a trusted source of information and a springboard to other information. Conclusions: The Head and Neck Cancer Australia website provides a wide range of information and support in multiple formats available to HNC patients. Further refinements in design, navigation and website instructions are needed to allow effective patient interaction.

Uma proposta de processo de avaliação da usabilidade de aplicativos para prática de exercícios físicos / A proposal of usability evaluation process for fitness mobile applications / Una propuesta de proceso de evaluación de la usabilidad de aplicaciones para la práctica del ejercicio físico

Objetivo: Este artigo apresenta uma proposta de processo de avaliação da usabilidade de aplicativos móveis para prática de exercícios físicos. Método: Inicialmente, realizou-se um mapeamento sistemático da literatura a fim de identificar quais métodos de avaliação de usabilidade são mais adequados para avaliar a interface de aplicativos de exercícios físicos. Em seguida, definiu-se um processo de avaliação baseado nas principais etapas dos métodos identificados. Posteriormente, esse processo foi utilizado na avaliação do aplicativo Exercícios em Casa. Resultados: Os resultados do mapeamento sistemático apontam como métodos mais utilizados o questionário System Usability Scale (SUS) (42%), o método think aloud (14%) e a técnica cognitive walkthrough (7%). O processo proposto foi modelado usando a notação SPEM para descrever a sequência de etapas necessárias para integrar estes três métodos. Após a modelagem, a proposta foi aplicada por três avaliadores que elencaram uma série de recomendações para melhoria do processo. Conclusão: Espera-se que esse processo permita aos desenvolvedores e projetistas de aplicativos móveis elaborarem aplicativos mais aderentes às necessidades de usuários/praticantes de exercícios físicos.

Objective: This paper presents a proposal of usability evaluation process of mobile fitness applications. Method: Firstly, a systematic literature mapping was carried out in order to identify most suitable usability evaluation methods for evaluating the interface of physical exercise applications. Then, an usability evaluation process was defined based on the main steps of the identified methods. Subsequently, this process was used in the evaluation of the mobile application "Exercícios em Casa" (Exercises at Home application). Results: The results of the systematic mapping indicate as the most used methods the System Usability Scale (SUS) questionnaire (42%), the think aloud method (14%) and the cognitive walkthrough technique (7%). The proposed process was modeled using SPEM notation to describe the sequence of steps required to integrate these three methods. After the modeling, the proposal was applied by three evaluators who listed a series of recommendations for the process improvement. Conclusion: We expect that this process allows developers and designers of mobile applications to develop tools more adherent to the needs of users/practitioners of physical exercise.

Objetivo: Este artículo presenta una propuesta de proceso de evaluación de usabilidad de aplicaciones de fitness móvil. Método: En primer lugar, se realizó un mapeo sistemático de la literatura con el fin de identificar los métodos de evaluación de la usabilidad más adecuados para evaluar la interfaz de las aplicaciones de ejercicios físicos. El proceso de evaluación se definió con base en los pasos principales de los métodos identificados. Posteriormente, este proceso fue utilizado en la evaluación de la aplicación móvil "Exercícios em Casa" (Ejercicios en Casa). Resultados: Los resultados del mapeo sistemático señalan como los métodos más utilizados el cuestionario System Usability Scale (SUS) (42%), el think aloud (14%) y la técnica de cognitive walkthrough (7%). El proceso propuesto se modeló utilizando la notación SPEM para describir la secuencia de pasos necesarios para integrar estos tres métodos. Luego del modelado, la propuesta fue aplicada por tres evaluadores quienes enlistaron una serie de recomendaciones para la mejora del proceso. Conclusión: Esperamos que este proceso permita a los programadores y diseñadores de aplicaciones móviles programar aplicaciones más acordes a las necesidades de los usuarios/practicantes de ejercicios físicos.

Dentists' perceptions and usability testing toward the implementation of the ISAC, a comprehensive oral cancer intervention in dental practices: a qualitative study in Jazan region, Saudi Arabia.

OBJECTIVE: We aimed to explore dentists' perceptions toward the implementation of a comprehensive intervention (ISAC) for the early detection and prevention of oral cancer in a dental clinic. METHODS: The ISAC intervention was presented to ten purposefully sampled dentists in Jazan Dental School (JDS). Participating dental interns were asked to practice the ISAC intervention whilst thinking aloud. A semi-structured interview technique was used to allow free expression of participants' perceptions related to the ISAC intervention and to control the flow of topics. Fleuren's framework theory informed the analysis. The interviews were transcribed verbatim and analyzed using the deductive-inductive framework analysis. RESULTS: Practicing the ISAC intervention was perceived to enhance the early detection and prevention of oral cancer. Serving community needs and engaging community groups were perceived to be related to a high relevance and compatibility of the ISAC intervention. Being a comprehensive intervention with well-defined objectives and being built on relevant data from the participants' community and having dentists as a target group were the perceived relative advantages of the ISAC intervention compared to other programs. A supportive environment, gender-concordance, use of regional trainers, standard examination form and collaboration with other sectors were perceived to be the facilitators. Competition with clinical time, use of different examination forms and low organizational leader interests were perceived as impeding factors against effective implementation in a real-world context. Reward, easy to practice, feeling confidence and satisfaction, advertisement as well as use of a role model approach were perceived to be motivating factors. CONCLUSIONS: Integrating data from representers of different participant groups during intervention conceptualization and development are critical for the intervention compatibility and acceptability. The study findings showed the opportunities of intertwining the intrinsic motivators of satisfaction and altruism existing in the target group and the extrinsic motivator of official diagnostic skill, certification that may boost and sustain the behavior change. Intervention features that influence perceived relevance, compatibility, relative advantage and motivation may be of great importance for intervention practice.