HCI-modelling for improving the clinical usability of digital health technologies.

INTRODUCTION: Digital Health Technologies (DHTs) have been shown to have variable usability as measured by efficiency, effectiveness and user satisfaction despite large-scale government projects to regulate and standardise user interface (UI) design. We hypothesised that Human-Computer Interaction (HCI) modelling could improve the methodology for DHT design and regulation, and support the creation of future evidence-based UI standards and guidelines for DHTs. METHODOLOGY: Using a Design Science Research (DSR) framework, we developed novel UI components that adhered to existing standards and guidelines (combining the NHS Common User Interface (CUI) standard and the NHS Design System). We firstly evaluated the Patient Banner UI component for compliance with the two guidelines and then used HCI-modelling to evaluate the "Add New Patient" workflow to measure time to task completion and cognitive load. RESULTS: Combining the two guidelines to produce new UI elements is technically feasible for the Patient Banner and the Patient Name Input components. There are some inconsistencies between the NHS Design System and the NHS CUI when implementing the Patient Banner. HCI-modelling successfully quantified challenges adhering to the NHS CUI and the NHS Design system for the "Add New Patient" workflow. DISCUSSION: We successfully developed new design artefacts combing two major design guidelines for DHTs. By quantifying usability issues using HCI-modelling, we have demonstrated the feasibility of a methodology that combines HCI-modelling into a human-centred design (HCD) process could enable the development of standardised UI elements for DHTs that is more scientifically robust than HCD alone. CONCLUSION: Combining HCI-modelling and Human-Centred Design could improve scientific progress towards developing safer and more user-friendly DHTs.

Best Practices for the Electronic Implementation and Migration of Patient-Reported Outcome Measures.

While the use of electronic methods to collect patient-reported outcome data in clinical trials continues to increase, it remains the case that many patient-reported outcome measures (PROMs) have originally been developed and validated on paper. Careful consideration during the move from paper PROMs to electronic format is required to preserve the integrity of the measure and ensure a "faithful migration." Relevant literature has long called out the importance of following migration best practices during this process; nevertheless, such best practices are distributed across multiple documents. This article consolidates and builds upon existing electronic PROM implementation best practice recommendations to provide a comprehensive, up-to-date, single point of reference. It reflects the current consensus based on the significant advances in technology capabilities and knowledge gleaned from the growing evidence base on electronic migration and implementation, to balance the need for maintaining the integrity of the measure while optimizing respondent usability. It also specifies whether the practice is rooted in evidence or expert consensus, to enable those using these best practices to make informed and considered decisions when conducting migration.

Accuracy and usability of artificial intelligence chatbot generated chemotherapy protocols.

Background: Medical practitioners are increasingly using artificial intelligence (AI) chatbots for easier and faster access to information. To our knowledge, the accuracy and availability of AI-generated chemotherapy protocols has not yet been studied. Methods: Nine simulated cancer patient cases were designed and AI chatbots, ChatGPT version 3.5 (OpenAI) and Bing (Microsoft), were used to generate chemotherapy protocols for each case. Results: Generated chemotherapy protocols were compared with the original protocols for nine simulated cancer patients. ChatGPT's overall performance was 5 out of 9 on protocol generation, and Bing's was 4 out of 9; this was statistically nonsignificant (p = 1). Conclusion: AI chatbots show both potential and limitations in generating chemotherapy protocols. The overall performance is low, and they should be used carefully in oncological practice.

[Box: see text].

Resilience eDBT: Development and Usability Evaluation of a Dialectical Behavior Therapy Skills Training App for Eating Disorders.

OBJECTIVE: Dialectical behavior therapy (DBT) is an evidence-based treatment for disorders characterized by recurrent binge eating. Yet, access to specialized treatment like DBT remains limited. To increase the accessibility of DBT, we developed a DBT skills training app (Resilience: eDBT) for the management of eating disorder (ED) symptoms. This paper delineates the developmental process of Resilience and tests its usability. METHODS: Descriptive information on the development and features of Resilience is provided, including its framework, content structure and delivery formats, functionality, data storage procedure, and privacy protocols. Usability was assessed via a mixed methods approach in 10 symptomatic individuals. Qualitative data were organized based on an existing framework, which included six themes: usability, visual design, user engagement, content, therapeutic persuasiveness, and therapeutic alliance. RESULTS: Resilience demonstrated good usability via a Systems Usability Scale score of 85.5, which exceeded the recommended cutoff of 68. Positive aspects of the app, according to interview data, were the ease of use and the visual design, while the addition of peer support was suggested as an opportunity for improvement. DISCUSSION: A novel DBT-based app may serve as an acceptable, low-intensity option or adjunct to traditional treatment for targeting ED symptoms that emerge in daily life. However, notable limitations include the small sample size and the single time point at which the usability assessment was conducted.

Electronic Patient-Reported Outcomes in Hidradenitis Suppurativa: Content Validity and Usability of the Electronic Hidradenitis Suppurativa Symptom Daily Diary, Hidradenitis Suppurativa Symptom Questionnaire, and Hidradenitis Suppurativa Quality of Life Questionnaire.

BACKGROUND: Hidradenitis suppurativa (HS), a chronic skin condition that causes pain and physical dysfunction, can impact significantly on quality of life. Disease-specific tools have been designed to assess the impact of HS on patients, including the HS Symptom Daily Diary (HSSDD), the HS Symptom Questionnaire (HSSQ), and the HS Quality of Life (HiSQOL©) questionnaire, which have been developed into electronic instruments (eHSSDD, eHSSQ, and eHiSQOL©). OBJECTIVES: The objective of this study was to establish the content validity of the electronic version of the HSSDD and HSSQ, and the acceptability and usability of the HSSDD, HSSQ, and HiSQOL©, using concept elicitation and cognitive debriefing interviews. METHODS: This was a non-interventional qualitative video interview study involving participants aged ≥18 years with moderate to severe HS recruited from a single clinical site in the USA. Interviews gathered feedback on participants' symptom experience, followed by training and completion of the eHSSDD, eHSSQ, and eHiSQOL© questionnaires on electronic handheld devices. Participants were then interviewed on the content of the eHSSDD and eHSSQ and the acceptability and usability of all three instruments. Interviews were transcribed and qualitatively analysed. RESULTS: Twenty participants with moderate to severe HS (median age: 41.5 [range: 20.0-64.0]; n = 16/20 female) were included. All participants found the eHSSDD, eHSSQ, and eHiSQOL© instructions clear and described the instruments as "easy", "simple" and "self-explanatory". Overall understanding of individual items within the eHSSDD and eHSSQ was high; however, 6/20 participants had difficulty in understanding the average skin pain item in the eHSSDD. All participants were able to accurately recall their symptoms within the recall periods of the eHSSDD and eHSSQ, although 4/20 participants found the 24-h recall period of the eHSSDD limiting. Completion time was quick across all instruments, and usability was high, with the majority of participants reporting no difficulty in completing questionnaires on electronic devices. CONCLUSION: The concepts covered in the eHSSDD and eHSSQ are relevant and important to patients, supporting their content validity. The findings also provide evidence of acceptability and usability of the eHSSDD, eHSSQ, and eHiSQOL©. A limitation was that all participants were recruited from a single site, which may have introduced selection bias and thus limited the generalisability of results.

Rehabilitation activities with tablet (REACT) in Parkinson's disease.

INTRODUCTION: There is evidence to demonstrate that plasticity is "use-dependent" and that intensive practice may be necessary to modify neural organization. PURPOSE: The main aim of this work is to investigate the REACT usability, an innovative app, to assist People with Parkinson Disease (PwPD) at home. METHODS: A pilot study has been conducted enrolling 20 consecutive PwPD. Before home rehabilitation activities started, each patient received training on the REACT app and how to use the device and the services in daily practice. Motor and cognitive evaluations were administered to assign personalized exercises, tailored to patients' needs and potential. PwPD carried out REACT home program for 1 month, four times a week. The app included motor exercise and tutorial of activities of daily living (ADL) and functional cognitive stimulation. REACT-app usability was evaluated with the System Usability Scale (SUS). RESULTS: The results from SUS questionnaire were, on average, above the threshold of "good usability" (SUS score > 68), as reported in the literature. The 47% of PwPD that used the app rated the usability of the solution as "excellent." Almost all SUS items reached the reference benchmark (except items 4, 5, and 7). No adverse events occurred. CONCLUSIONS: REACT can be considered a useful and safe tool to support the continuity of care and treatment at home, in PwPD. Larger-scale trials are needed to validate the good acceptance and efficacy of home rehabilitation through technology applications.

Evaluation of usability, adherence, and clinical efficacy of therapeutic footwear in persons with diabetes at moderate to high risk of diabetic foot ulcers: A multicenter prospective study.

OBJECTIVE: To evaluate therapeutic footwear expectations and usability of individuals with diabetes and foot complications. DESIGN: A prospective multicenter study was conducted on participants with a high risk of developing a diabetic foot ulcer. SETTING: Participants were enrolled in 11 different specialized diabetic foot units in Spain between March 2022 and June 2023. SUBJECTS: Patients with diabetes at moderate to high risk of foot ulceration receiving first therapeutic footwear prescription. INTERVENTIONS: All the patients included in the research were prescribed with their first pair of therapeutic footwear. MAIN MEASURES: Primary outcome measures were MOS-pre and MOS-post questionnaires evaluating use and usability of prescribed therapeutic footwear. Secondary outcome measures aimed to evaluate footwear clinical efficacy as ulceration rate and self-reported perceived walking distance per day. RESULTS: The use of therapeutic footwear exceeded the patient's pre-provision prediction of their anticipated use in 94% of people (n = 126). Based on the visual analogic satisfaction scale, the median satisfaction of daily wearing their therapeutic footwear was 7 points, Interquartile Range (IQR) [5-8.25]. During the follow-up period, 39 participants (29.1%) experienced diabetic foot ulcer. Perceived walking distance participants reported an improvement in their perceived walking ability during various daily life activities. CONCLUSIONS: Diabetes patients at moderate to high risk of diabetic foot ulcer improved their perception of walking ability after therapeutic footwear prescription. Adherence to the therapeutic footwear prescription resulted in less ulcerations.

Digital clinical empathy in a live chat: multiple findings from a formative qualitative study and usability tests.

BACKGROUND: Clinical empathy is considered a crucial element in patient-centered care. The advent of digital technology in healthcare has introduced new dynamics to empathy which needs to be explored in the context of the technology, particularly within the context of written live chats. Given the growing prevalence of written live chats, this study aimed to explore and evaluate techniques of digital clinical empathy within a familial cancer-focused live chat, focusing on how health professionals can (a) understand, (b) communicate, and (c) act upon users' perspectives and emotional states. METHODS: The study utilized a qualitative approach in two research phases. It examined the expected and implemented techniques and effectiveness of digital clinical empathy in a live chat service, involving semi-structured interviews with health professionals (n = 9), focus group discussions with potential users (n = 42), and two rounds of usability tests between health professionals (n = 9) and users (n = 18). Data were examined using qualitative content analysis. RESULTS: Expected techniques of digital clinical empathy, as articulated by both users and health professionals, involve reciprocal engagement, timely responses, genuine authenticity, and a balance between professionalism and informality, all while going beyond immediate queries to facilitate informed decision-making. Usability tests confirm these complexities and introduce new challenges, such as balancing timely, authentic responses with effective, personalized information management and carefully framed referrals. CONCLUSIONS: The study reveals that the digital realm adds layers of complexity to the practice of clinical empathy. It underscores the importance of ongoing adaptation and suggests that future developments could benefit from a hybrid model that integrates the strengths of both AI and human health professionals to meet evolving user needs and maintain high-quality, empathetic healthcare interactions.

Using Quality Improvement as a Mechanism for Fostering Partnerships and Promoting Equity in a Health System Change Model.

PURPOSE: Quality improvement (QI) processes provide a framework for systematically examining target outcomes and what changes can be made to result in improvement and ensure equity. We present a case study of how QI processes were used as a means of partnership building to enhance equity in designing materials for a Medicaid pilot program, North Carolina Integrated Care for Kids (NC InCK). DESCRIPTION: The NC InCK model addresses social determinants of health by providing structured care integration across core child health and social service areas and using an alternative payment model to incentivize high quality child outcomes. During the two-year planning period prior to the NC InCK model launch, we used Plan-Do-Study-Act (PDSA) cycles to conduct usability testing as a QI strategy for a component of the NC InCK model: the Shared Action Plan (SAP). ASSESSMENT: We conducted usability testing with four Family Council members, nine care managers, and one physician. Participants reviewed the SAP and provided feedback via a survey. After reviewing feedback with InCK leadership and the Family Council, we implemented recommendations that led to a SAP that uses clear and accessible language, that highlights family strengths and family-identified goals, and that is distinct from other care management plans. CONCLUSION: Usability testing forced refinement of materials before NC InCK launched, created opportunities for building and enhancing community partnerships and promoted equity within the NC InCK team and Family Council by considering multiple perspectives when deciding on SAP revisions.

Malnutrition risk assessment using a machine learning-based screening tool: A multicentre retrospective cohort.

BACKGROUND: Malnutrition is associated with increased morbidity, mortality, and healthcare costs. Early detection is important for timely intervention. This paper assesses the ability of a machine learning screening tool (MUST-Plus) implemented in registered dietitian (RD) workflow to identify malnourished patients early in the hospital stay and to improve the diagnosis and documentation rate of malnutrition. METHODS: This retrospective cohort study was conducted in a large, urban health system in New York City comprising six hospitals serving a diverse patient population. The study included all patients aged ≥ 18 years, who were not admitted for COVID-19 and had a length of stay of ≤ 30 days. RESULTS: Of the 7736 hospitalisations that met the inclusion criteria, 1947 (25.2%) were identified as being malnourished by MUST-Plus-assisted RD evaluations. The lag between admission and diagnosis improved with MUST-Plus implementation. The usability of the tool output by RDs exceeded 90%, showing good acceptance by users. When compared pre-/post-implementation, the rate of both diagnoses and documentation of malnutrition showed improvement. CONCLUSION: MUST-Plus, a machine learning-based screening tool, shows great promise as a malnutrition screening tool for hospitalised patients when used in conjunction with adequate RD staffing and training about the tool. It performed well across multiple measures and settings. Other health systems can use their electronic health record data to develop, test and implement similar machine learning-based processes to improve malnutrition screening and facilitate timely intervention.

Comparison of the Working Alliance in Blended Cognitive Behavioral Therapy and Treatment as Usual for Depression in Europe: Secondary Data Analysis of the E-COMPARED Randomized Controlled Trial.

BACKGROUND: Increasing interest has centered on the psychotherapeutic working alliance as a means of understanding clinical change in digital mental health interventions in recent years. However, little is understood about how and to what extent a digital mental health program can have an impact on the working alliance and clinical outcomes in a blended (therapist plus digital program) cognitive behavioral therapy (bCBT) intervention for depression. OBJECTIVE: This study aimed to test the difference in working alliance scores between bCBT and treatment as usual (TAU), examine the association between working alliance and depression severity scores in both arms, and test for an interaction between system usability and working alliance with regard to the association between working alliance and depression scores in bCBT at 3-month assessments. METHODS: We conducted a secondary data analysis of the E-COMPARED (European Comparative Effectiveness Research on Blended Depression Treatment versus Treatment-as-usual) trial, which compared bCBT with TAU across 9 European countries. Data were collected in primary care and specialized services between April 2015 and December 2017. Eligible participants aged 18 years or older and diagnosed with major depressive disorder were randomized to either bCBT (n=476) or TAU (n=467). bCBT consisted of 6-20 sessions of bCBT (involving face-to-face sessions with a therapist and an internet-based program). TAU consisted of usual care for depression. The main outcomes were scores of the working alliance (Working Alliance Inventory-Short Revised-Client [WAI-SR-C]) and depressive symptoms (Patient Health Questionnaire-9 [PHQ-9]) at 3 months after randomization. Other variables included system usability scores (System Usability Scale-Client [SUS-C]) at 3 months and baseline demographic information. Data from baseline and 3-month assessments were analyzed using linear regression models that adjusted for a set of baseline variables. RESULTS: Of the 945 included participants, 644 (68.2%) were female, and the mean age was 38.96 years (IQR 38). bCBT was associated with higher composite WAI-SR-C scores compared to TAU (B=5.67, 95% CI 4.48-6.86). There was an inverse association between WAI-SR-C and PHQ-9 in bCBT (B=-0.12, 95% CI -0.17 to -0.06) and TAU (B=-0.06, 95% CI -0.11 to -0.02), in which as WAI-SR-C scores increased, PHQ-9 scores decreased. Finally, there was a significant interaction between SUS-C and WAI-SR-C with regard to an inverse association between higher WAI-SR-C scores and lower PHQ-9 scores in bCBT (b=-0.030, 95% CI -0.05 to -0.01; P=.005). CONCLUSIONS: To our knowledge, this is the first study to show that bCBT may enhance the client working alliance when compared to evidence-based routine care for depression that services reported offering. The working alliance in bCBT was also associated with clinical improvements that appear to be enhanced by good program usability. Our findings add further weight to the view that the addition of internet-delivered CBT to face-to-face CBT may positively augment experiences of the working alliance. TRIAL REGISTRATION: ClinicalTrials.gov NCT02542891, https://clinicaltrials.gov/study/NCT02542891; German Clinical Trials Register DRKS00006866, https://drks.de/search/en/trial/DRKS00006866; Netherlands Trials Register NTR4962, https://www.onderzoekmetmensen.nl/en/trial/25452; ClinicalTrials.Gov NCT02389660, https://clinicaltrials.gov/study/NCT02389660; ClinicalTrials.gov NCT02361684, https://clinicaltrials.gov/study/NCT02361684; ClinicalTrials.gov NCT02449447, https://clinicaltrials.gov/study/NCT02449447; ClinicalTrials.gov NCT02410616, https://clinicaltrials.gov/study/NCT02410616; ISRCTN Registry ISRCTN12388725, https://www.isrctn.com/ISRCTN12388725?q=ISRCTN12388725&filters=&sort=&offset=1&totalResults=1&page=1&pageSize=10; ClinicalTrials.gov NCT02796573, https://classic.clinicaltrials.gov/ct2/show/NCT02796573. INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID): RR2-10.1186/s13063-016-1511-1.

Developing and Testing the Usability of a Novel Child Abuse Clinical Decision Support System: Mixed Methods Study.

BACKGROUND: Despite the impact of physical abuse on children, it is often underdiagnosed, especially among children evaluated in emergency departments (EDs). Electronic clinical decision support (CDS) can improve the recognition of child physical abuse. OBJECTIVE: We aimed to develop and test the usability of a natural language processing-based child abuse CDS system, known as the Child Abuse Clinical Decision Support (CA-CDS), to alert ED clinicians about high-risk injuries suggestive of abuse in infants' charts. METHODS: Informed by available evidence, a multidisciplinary team, including an expert in user design, developed the CA-CDS prototype that provided evidence-based recommendations for the evaluation and management of suspected child abuse when triggered by documentation of a high-risk injury. Content was customized for medical versus nursing providers and initial versus subsequent exposure to the alert. To assess the usability of and refine the CA-CDS, we interviewed 24 clinicians from 4 EDs about their interactions with the prototype. Interview transcripts were coded and analyzed using conventional content analysis. RESULTS: Overall, 5 main categories of themes emerged from the study. CA-CDS benefits included providing an extra layer of protection, providing evidence-based recommendations, and alerting the entire clinical ED team. The user-centered, workflow-compatible design included soft-stop alert configuration, editable and automatic documentation, and attention-grabbing formatting. Recommendations for improvement included consolidating content, clearer design elements, and adding a hyperlink with additional resources. Barriers to future implementation included alert fatigue, hesitancy to change, and concerns regarding documentation. Facilitators of future implementation included stakeholder buy-in, provider education, and sharing the test characteristics. On the basis of user feedback, iterative modifications were made to the prototype. CONCLUSIONS: With its user-centered design and evidence-based content, the CA-CDS can aid providers in the real-time recognition and evaluation of infant physical abuse and has the potential to reduce the number of missed cases.

Longitudinal Monitoring of Clinician-Patient Video Visits During the Peak of the COVID-19 Pandemic: Adoption and Sustained Challenges in an Integrated Health Care Delivery System.

BACKGROUND: Numerous prior opinion papers, administrative electronic health record data studies, and cross-sectional surveys of telehealth during the pandemic have been published, but none have combined assessments of video visit success monitoring with longitudinal assessments of perceived challenges to the rapid adoption of video visits during the pandemic. OBJECTIVE: This study aims to quantify (1) the use of video visits (compared with in-person and telephone visits) over time during the pandemic, (2) video visit successful connection rates, and (3) changes in perceived video visit challenges. METHODS: A web-based survey was developed for the dual purpose of monitoring and improving video visit implementation in our health care system during the COVID-19 pandemic. The survey included questions regarding rates of in-person, telephone, and video visits for clinician-patient encounters; the rate of successful connection for video visits; and perceived challenges to video visits (eg, software, hardware, bandwidth, and technology literacy). The survey was distributed via email to physicians, advanced practice professionals, and clinicians in May 2020. The survey was repeated in March 2021. Differences between the 2020 and 2021 responses were adjusted for within-respondent correlation across surveys and tested using generalized estimating equations. RESULTS: A total of 1126 surveys were completed (511 surveys in 2020 and 615 surveys in 2021). In 2020, only 21.7% (73/336) of clinicians reported no difficulty connecting with patients during video visits and 28.6% (93/325) of clinicians reported no difficulty in 2021. The distribution of the percentage of successfully connected video visits ("Over the past two weeks of scheduled visits, what percentage did you successfully connect with patients by video?") was not significantly different between 2020 and 2021 (P=.74). Challenges in conducting video visits persisted over time. Poor connectivity was the most common challenge reported by clinicians. This response increased over time, with 30.5% (156/511) selecting it as a challenge in 2020 and 37.1% (228/615) in 2021 (P=.01). Patients not having access to their electronic health record portals was also a commonly reported challenge (109/511, 21.3% in 2020 and 137/615, 22.3% in 2021, P=.73). CONCLUSIONS: During the pandemic, our health care delivery system rapidly adopted synchronous patient-clinician communication using video visits. As experience with video visits increased, the reported failure rate did not significantly decline, and clinicians continued to report challenges related to general network connectivity and patient access to technology.

Development of an Artificial Intelligence-Based Tailored Mobile Intervention for Nurse Burnout: Single-Arm Trial.

BACKGROUND: Nurse burnout leads to an increase in turnover, which is a serious problem in the health care system. Although there is ample evidence of nurse burnout, interventions developed in previous studies were general and did not consider specific burnout dimensions and individual characteristics. OBJECTIVE: The objectives of this study were to develop and optimize the first tailored mobile intervention for nurse burnout, which recommends programs based on artificial intelligence (AI) algorithms, and to test its usability, effectiveness, and satisfaction. METHODS: In this study, an AI-based mobile intervention, Nurse Healing Space, was developed to provide tailored programs for nurse burnout. The 4-week program included mindfulness meditation, laughter therapy, storytelling, reflective writing, and acceptance and commitment therapy. The AI algorithm recommended one of these programs to participants by calculating similarity through a pretest consisting of participants' demographics, research variables, and burnout dimension scores measured with the Copenhagen Burnout Inventory. After completing a 4-week program, burnout, job stress, stress response using the Stress Response Inventory Modified Form, the usability of the app, coping strategy by the coping strategy indicator, and program satisfaction (1: very dissatisfied; 5: very satisfied) were measured. The AI recognized the recommended program as effective if the user's burnout score reduced after the 2-week program and updated the algorithm accordingly. After a pilot test (n=10), AI optimization was performed (n=300). A paired 2-tailed t test, ANOVA, and the Spearman correlation were used to test the effect of the intervention and algorithm optimization. RESULTS: Nurse Healing Space was implemented as a mobile app equipped with a system that recommended 1 program out of 4 based on similarity between users through AI. The AI algorithm worked well in matching the program recommended to participants who were most similar using valid data. Users were satisfied with the convenience and visual quality but were dissatisfied with the absence of notifications and inability to customize the program. The overall usability score of the app was 3.4 out of 5 points. Nurses' burnout scores decreased significantly after the completion of the first 2-week program (t=7.012; P<.001) and reduced further after the second 2-week program (t=2.811; P=.01). After completing the Nurse Healing Space program, job stress (t=6.765; P<.001) and stress responses (t=5.864; P<.001) decreased significantly. During the second 2-week program, the burnout level reduced in the order of participation (r=-0.138; P=.04). User satisfaction increased for both the first (F=3.493; P=.03) and second programs (F=3.911; P=.02). CONCLUSIONS: This program effectively reduced burnout, job stress, and stress responses. Nurse managers were able to prevent nurses from resigning and maintain the quality of medical services using this AI-based program to provide tailored interventions for nurse burnout. Thus, this app could improve qualitative health care, increase employee satisfaction, reduce costs, and ultimately improve the efficiency of the health care system.

Knowledge, usability and challenges of e-learning platforms for continuing Professional Development of healthcare professionals at University Teaching Hospital of Kigali.

BACKGROUND: Healthcare professionals constitute a critical component of clinical care services. To provide the expected service, they must continuously develop their profession through continuous learning. This kind of learning is recognized as continuing professional development (CPD). Traditionally, CPD is offered onsite. Onsite training is associated with some barriers that prevent healthcare professionals from attending such educational activities, including financial difficulties and long distance. This is why online learning is proposed to overcome these barriers. OBJECTIVE: The main purpose was to evaluate usability, knowledge and challenges of e-learning platforms for CPD of healthcare professionals at University Teaching Hospital of Kigali (CHUK). METHODS: The cross-sectional quantitative study approach was utilized; the data was collected at the workplace of nurses, midwives, and allied health professionals by using a pre-designed questionnaire. The data were analyzed using Statistical Package for the Social Sciences (SPSS) version 25 and presented as frequencies. RESULTS: A significant majority was aware of CPD e-learning platforms. For example, 95.7% of the participants were familiar with these platforms, indicating that they had some degree of knowledge about their existence and purpose. Regarding the mode of accessing CPD courses, 82.1% of participants preferred online platforms, demonstrating a strong will to use e-learning platforms. CONCLUSION: This study highlighted a high level of awareness and utilization of CPD e-learning platforms among healthcare professionals at CHUK, additionally, participants expressed confidence in using the platforms but emphasized the need for further support and training.

WeChat mini program in laboratory biosafety education among medical students at Guangzhou Medical University: a mixed method study of feasibility and usability.

BACKGROUND: Laboratory biosafety should be a priority in all healthcare institutions. In traditional laboratory safety teaching students typically receive knowledge passively from their teachers without active involvement. The combination of experiential learning and mobile learning may provide students with greater engagement, retention, and application of knowledge. To address this issue, we developed and conducted a convergent mixed methods study to assess the feasibility and usability of a WeChat mini program (WMP) named WeMed for laboratory biosafety education for medical laboratory students at Guangzhou Medical University (GMU). METHODS: The study was conducted between November 2022 and October 2023 among second-year undergraduate students at GMU. It involved the concurrent collection, analysis, and interpretation of both qualitative and quantitative data to assess feasibility and usability. In the quantitative strand, two evaluations were conducted via online surveys from students (n = 67) after a four-week study period. The System Usability Scale (SUS) was used to evaluate usability, while self-developed questions were used to assess feasibility. Additionally, a knowledge test was administered 6 months after the program completion. In the qualitative strand, fourteen semi-structured interviews were conducted, whereby a reflexive thematic analysis was utilized to analyze the interview data. RESULTS: The overall SUS score is adequate (M = 68.17, SD = 14.39). The acceptability of the WeMed program is in the marginal high range. Most students agreed that WeMed was useful for learning biosafety knowledge and skills (13/14, 93%), while 79% (11/14) agreed it was easy to use and they intended to continue using it. After 6 months, a significant difference in the knowledge test scores was observed between the WeMed group (n = 67; 2nd year students) and the traditional training group (n = 90; 3rd year students). However, the results should be interpreted cautiously due to the absence of a pretest. CONCLUSION: The combination of experiential learning and mobile learning with WMP is a feasible tool for providing laboratory biosafety knowledge and skills. Ongoing improvements should be made in order to increase long-term acceptance.

The feasibility and usability of mixed reality teaching in a hospital setting based on self-reported perceptions of medical students.

BACKGROUND: Clinical teaching during encounters with real patients lies at the heart of medical education. Mixed reality (MR) using a Microsoft HoloLens 2 (HL2) offers the potential to address several challenges: including enabling remote learning; decreasing infection control risks; facilitating greater access to medical specialties; and enhancing learning by vertical integration of basic principles to clinical application. We aimed to assess the feasibility and usability of MR using the HL2 for teaching in a busy, tertiary referral university hospital. METHODS: This prospective observational study examined the use of the HL2 to facilitate a live two-way broadcast of a clinician-patient encounter, to remotely situated third and fourth year medical students. System Usability Scale (SUS) Scores were elicited from participating medical students, clinician, and technician. Feedback was also elicited from participating patients. A modified Evaluation of Technology-Enhanced Learning Materials: Learner Perceptions Questionnaire (mETELM) was completed by medical students and patients. RESULTS: This was a mixed methods prospective, observational study, undertaken in the Day of Surgery Assessment Unit. Forty-seven medical students participated. The mean SUS score for medical students was 71.4 (SD 15.4), clinician (SUS = 75) and technician (SUS = 70) indicating good usability. The mETELM Questionnaire using a 7-point Likert Scale demonstrated MR was perceived to be more beneficial than a PowerPoint presentation (Median = 7, Range 6-7). Opinion amongst the student cohort was divided as to whether the MR tutorial was as beneficial for learning as a live patient encounter would have been (Median = 5, Range 3-6). Students were positive about the prospect of incorporating of MR in future tutorials (Median = 7, Range 5-7). The patients' mETELM results indicate the HL2 did not affect communication with the clinician (Median = 7, Range 7-7). The MR tutorial was preferred to a format based on small group teaching at the bedside (Median = 6, Range 4-7). CONCLUSIONS: Our study findings indicate that MR teaching using the HL2 demonstrates good usability characteristics for providing education to medical students at least in a clinical setting and under conditions similar to those of our study. Also, it is feasible to deliver to remotely located students, although certain practical constraints apply including Wi-Fi and audio quality.

Searchable Blockchain-Based Healthcare Information Exchange System to Enhance Privacy Preserving and Data Usability.

Ensuring the security and usability of electronic health records (EHRs) is important in health information exchange (HIE) systems that handle healthcare records. This study addressed the need to balance privacy preserving and data usability in blockchain-based HIE systems. We propose a searchable blockchain-based HIE system that enhances privacy preserving while improving data usability. The proposed methodology includes users collecting healthcare information (HI) from various Internet of Medical Things (IoMT) devices and compiling this information into EHR blocks for sharing on a blockchain network. This approach allows participants to search and utilize specific health data within the blockchain effectively. The results demonstrate that the proposed system mitigates the issues of traditional HIE systems by providing secure and user-friendly access to EHRs. The proposed searchable blockchain-based HIE system resolves the trade-off dilemma in HIE by achieving a balance between security and the data usability of EHRs.

A Framework for Selecting and Assessing Wearable Sensors Deployed in Safety Critical Scenarios.

Wearable sensors for psychophysiological monitoring are becoming increasingly mainstream in safety critical contexts. They offer a novel solution to capturing sub-optimal states and can help identify when workers in safety critical environments are suffering from states such as fatigue and stress. However, sensors can differ widely in their application, design, usability, and measurement and there is a lack of guidance on what should be prioritized or considered when selecting a sensor. The paper aims to highlight which concepts are important when creating or selecting a device regarding the optimization of both measurement and usability. Additionally, the paper discusses how design choices can enhance both the usability and measurement capabilities of wearable sensors. The hopes are that this paper will provide researchers and practitioners in human factors and related fields with a framework to help guide them in building and selecting wearable sensors that are well suited for deployment in safety critical contexts.

Introducing a Remote Patient Monitoring Usability Impact Model to Overcome Challenges.

Telehealth and remote patient monitoring (RPM), in particular, have been through a massive surge of adoption since 2020. This initiative has proven potential for the patient and the healthcare provider in areas such as reductions in the cost of care. While home-use medical devices or wearables have been shown to be beneficial, a literature review illustrates challenges with the data generated, driven by limited device usability. This could lead to inaccurate data when an exam is completed without clinical supervision, with the consequence that incorrect data lead to improper treatment. Upon further analysis of the existing literature, the RPM Usability Impact model is introduced. The goal is to guide researchers and device manufacturers to increase the usability of wearable and home-use medical devices in the future. The importance of this model is highlighted when the user-centered design process is integrated, which is needed to develop these types of devices to provide the proper user experience.