ABSTRACT
OBJECTIVE: The prototype "Oldenburger Logopädie App" (OLA) was designed to support voice therapy for patients with recurrent paresis, such as to accompany homework or as a short-term substitute for regular therapy due to dropouts, such as during the COVID-19 pandemic. The treating speech and language pathologists (SLPs) unlocks videos individually applicable to the respective patients, in which the SLPs instruct the individual exercises. The app can be used without information technology knowledge or detailed instructions. MATERIALS AND METHODS: The prototype's usability was evaluated through a usability test battery (AttrakDiff questionnaire, System Usability Scale, Visual Aesthetics of Websites Inventory questionnaire) and informal interviews from the perspective of patients and SLPs. RESULTS: The acceptance, usability, user experience, self-descriptiveness, and user behavior of OLA were consistently given and mostly rated as positive. Both user groups rated OLA as practical and easy to use (eg, System Usability Scale: "practical" (agree: ∅ 49.5%), "cumbersome to use" (total: strongly disagree: ∅ 60.0%). However, the monotonous layout of the app and the instructional and exercise videos should be modified in the next editing step. An overview of relevant criteria for a voice therapy app, regarding design and functions, was derived from the results. CONCLUSION: This user-oriented feedback on the usability of the voice app provides the proof of concept and the basis for the further development of the Artificial intelligence-based innovative follow-up app LAOLA. In the future, it should be possible to support the treatment of all voice disorders with such an app. For the further development of the voice app, the therapeutic content and the effectiveness of the training should also be investigated.
ABSTRACT
Workforce well-being and associated factors such as burnout, depression and documentation burden, have been identified as the highest concerns to be addressed. In academia, the new essentials of nursing practice including domain 8 for informatics and healthcare technology have become a focus for curricular revisions/enhancements. Our study focused on technology skills by using the technology of an academic EHR to measure baselines and progression of EHR use, sense of confidence, documentation competency, and post-graduation employer-based performance assessment. We provide results of an ongoing 1.5-year study and overarching strategy for university-wide deployment and financing.
Subject(s)
Curriculum , Electronic Health Records , Education, Nursing , Nursing Informatics/education , HumansABSTRACT
Introduction: Forensic psychiatric patients receive treatment to address their violent and aggressive behavior with the aim of facilitating their safe reintegration into society. On average, these treatments are effective, but the magnitude of effect sizes tends to be small, even when considering more recent advancements in digital mental health innovations. Recent research indicates that wearable technology has positive effects on the physical and mental health of the general population, and may thus also be of use in forensic psychiatry, both for patients and staff members. Several applications and use cases of wearable technology hold promise, particularly for patients with mild intellectual disability or borderline intellectual functioning, as these devices are thought to be user-friendly and provide continuous daily feedback. Method: In the current randomized crossover trial, we addressed several limitations from previous research and compared the (continuous) usability and acceptance of four selected wearable devices. Each device was worn for one week by staff members and patients, amounting to a total of four weeks. Two of the devices were general purpose fitness trackers, while the other two devices used custom made applications designed for bio-cueing and for providing insights into physiological reactivity to daily stressors and events. Results: Our findings indicated significant differences in usability, acceptance and continuous use between devices. The highest usability scores were obtained for the two fitness trackers (Fitbit and Garmin) compared to the two devices employing custom made applications (Sense-IT and E4 dashboard). The results showed similar outcomes for patients and staff members. Discussion: None of the devices obtained usability scores that would justify recommendation for future use considering international standards; a finding that raises concerns about the adaptation and uptake of wearable technology in the context of forensic psychiatry. We suggest that improvements in gamification and motivational aspects of wearable technology might be helpful to tackle several challenges related to wearable technology.
ABSTRACT
Single-item scales of perceived usability are attractive due to their efficiency and non-verbal scales are attractive because they enable collecting data from individuals irrespective of their language proficiency. We tested experimentally whether single-item verbal and pictorial scales can compete with their 10-item counterparts at reflecting the difference in usability between well-designed and poorly designed systems. N = 1079 (Experiment 1) and N = 1092 (Experiment 2) participants worked with two systems whose usability was experimentally manipulated. Perceived usability was assessed using the 10-item System Usability Scale, the single-item Adjective Rating Scale, the 10-item Pictorial System Usability Scale and the Pictorial Single-Item Usability Scale. The single-item scales reflect the difference in usability as good as their 10-item counterparts. The pictorial scales are nearly as valid as their verbal counterparts. The single-item Adjective Rating Scale and the Pictorial Single-Item Usability Scale are thus efficient and valid alternatives to their 10-item counterparts.
Verbal and pictorial single-item perceived-usability scales are viable alternatives to their 10-item counterparts. Specifically, the single-item Adjective Rating Scale is as good as the 10-item System Usability Scale and the Pictorial Single-Item Usability Scale is as good as the Pictorial System Usability Scale at reflecting differences in usability between systems.
ABSTRACT
Learning 2D sectional anatomy facilitates the comprehension of 3D anatomical structures, anatomical relationships, and radiological anatomy. However, the efficacy of technology-enhanced collaborative instructional activities in sectional anatomy remains unclear, especially if theoretical frameworks, namely the Cognitive Theory of Multimedia Learning (CTML), are applied in instructional design. Thus, this study compared the educational impact of distinct 45-min-long technology-enhanced collaborative learning tasks in sectional anatomy. A sample of 115 first-year medical students was randomly divided into three experimental groups that used different supporting technologies to learn the sectional anatomy of the chest: IMAIOS e-learning platform and Microsoft Surface Hub (n = 37); anatomage table (n = 38); anatomage table with CTML-based presets (n = 40). Prelearning and postlearning tests revealed that significant knowledge gains in sectional anatomy were obtained by all groups even though no inter-group differences were found. Moreover, a five-point Likert scale questionnaire showed that the learning session was highly valued by all participants and that users of the anatomage with CTML-based presets reported higher enjoyment than users of the IMAIOS system (mean difference = 0.400; p = 0.037). In addition, students using the IMAIOS system and the anatomage with CTML-based presets provided System Usability Scale (SUS) scores of 67.64 and 67.69, respectively, reaching the benchmark of usability. By contrast, students using the anatomage table without presets awarded a SUS score of 64.14. These results suggest that the integration of multimedia technologies in anatomy teaching and learning should be grounded on CTML principles of instructional design. Otherwise, students' perceptions of ed-tech usability are potentially hindered.
ABSTRACT
BACKGROUND: Cyclic vomiting syndrome (CVS) is an enigmatic and debilitating disorder of gut-brain interaction that is characterized by recurrent episodes of severe vomiting and nausea. It significantly impairs patients' quality of life and can lead to frequent medical visits and substantial health care costs. The diagnosis for CVS is often protracted and complex, primarily due to its exclusionary diagnosis nature and the lack of specific biomarkers. This typically leads to a considerable delay in accurate diagnosis, contributing to increased patient morbidity. Additionally, the absence of approved therapies for CVS worsens patient hardship and reflects the urgent need for innovative, patient-centric solutions to improve CVS management. OBJECTIVE: We aim to develop a digital patient assistant (DPA) for patients with CVS to address their unique needs, and iteratively enhance the technical features and user experience on the initial DPA versions. METHODS: The development of the DPA for CVS used a design thinking approach, prioritizing user needs. A literature review and Patient Advisory Board shaped the initial prototype, focusing on diagnostic support and symptom tracking. Iterative development, informed by the design thinking approach and feedback from patients with CVS and caregivers through interviews and smartphone testing, led to significant enhancements in user interaction and artificial intelligence integration. The final DPA's effectiveness was validated using the System Usability Scale and feedback questions, ensuring it met the specific needs of the CVS community. RESULTS: The DPA developed for CVS integrates an introductory bot, daily and weekly check-in bots, and a knowledge hub, all accessible via a patient dashboard. This multicomponent solution effectively addresses key unmet needs in CVS management: efficient symptom and impacts tracking, access to comprehensive disease information, and a digital health platform for disease management. Significant improvements, based on user feedback, include the implementation of artificial intelligence features like intent recognition and data syncing, enhancing the bot interaction and reducing the burden on patients. The inclusion of the knowledge hub provides educational resources, contributing to better disease understanding and management. The DPA achieved a System Usability Scale score of 80 out of 100, indicating high ease of use and relevance. Patient feedback highlighted the DPA's potential in disease management and suggested further applications, such as integration into health care provider recommendations for patients with suspected or confirmed CVS. This positive response underscores the DPA's role in enhancing patient engagement and disease management through a patient-centered digital solution. CONCLUSIONS: The development of this DPA for patients with CVS, via an iterative design thinking approach, offers a patient-centric solution for disease management. The DPA development framework may also serve to guide future patient digital support and research scenarios.
ABSTRACT
Background: Mobile health (mHealth) apps can be used for cardiovascular disease (CVD) prevention. User-centered design, evidence-based content and user testing can be applied to ensure a high level of usability and adequate app access. Objective: To develop and evaluate an mHealth app (HerzFit) for CVD prevention. Methods: HerzFit´s development included a user-centered design approach and guideline-based content creation based on the identified requirements of the target group. Beta testing and a preliminary usability evaluation of the HerzFit prototype were performed. For evaluation, German versions of the System Usability Scale (SUS) and the mHealth App Usability Questionnaire (GER-MAUQ) as well as free text feedback were applied. Results: User-centered design thinking led to the definition of four personas. Based on their requirements, HerzFit enables users to individually assess, monitor, and optimize their cardiovascular risk profile. Users are also provided with a variety of evidence-based information on CVD and their risk factors. The user interface and system design followed the identified functional requirements. Beta-testers provided feedback on the structure and functionality and rated the usability of HerzFit´s prototype as slightly above average both in SUS and GER-MAUQ rating. Participants positively noted the variety of functions and information presented in HerzFit, while negative feedback mostly concerned wearable synchronization. Conclusions: The present study demonstrates the user-centered development of a guideline-based mHealth app for CVD prevention. Beta-testing and a preliminary usability study were used to further improve the HerzFit app until its official release.
ABSTRACT
Background: Aircraft software loading tools evolved as enhanced floppy disks and different types of portable data loaders emerged into the modern world. However, there was a lack of academic research centered on the usability of those tools. Objective: This study analyzed the usability of three aircraft software loading tools: floppy disks, Teledyne PMAT, and MBS mini PDL. Methods: A total of 20 avionics technicians answered 10 System Usability Scale (SUS) indicators and performed the software loading task. These professionals completed three sets of SUS questionnaires, one set for each software tool. Results: Analysis of Variance (ANOVA) indicated that there were statistical differences in SUS score and completion time. The comparable SUS score and completion time pertained to the following tools: floppy disks & MBS mini PDL and Teledyne PMAT & MBS mini PDL. Pearson correlation analysis noted a significant positive relationship between SUS score & software tool. Moreover, there was a significant negative relationship between SUS score & completion time and software tool & completion time. However, avionics technicians' years of experience lacked a significant impact on SUS score and completion time. Ultimately, it was recommended to utilize MBS mini PDL. This aircraft loading tool had the most significant impact, highest SUS score, and fastest completion time. Conclusions: The researchers presented managerial implications if MBS mini PDL was utilized, including sales increase and overhead cost savings. Finally, this research was the first study that analyzed the usability of the commonly used aircraft software loading tools.
ABSTRACT
BACKGROUND: We have been conducting a Japanese trial-ready cohort web study since 2019 as a web-based online registry to enroll individuals with preclinical Alzheimer's disease to facilitate trials on Alzheimer's disease prevention. The usability of a website might be an important factor in determining user participation and retention. OBJECTIVES: We conducted a user questionnaire survey to analyze the usability of the Japanese trial-ready cohort website and user characteristics for future website improvement. DESIGN: This was a cross-sectional prospective observational study. SETTING: Online survey using Google Forms. PARTICIPANTS: Among the Japanese trial-ready cohort web study participants, we enrolled those who provided consent to participate in the study and had completed one or more Cognitive Function Instrument tests before May 2, 2023. We sent an invitation e-mail, including the questionnaire web address, to eligible participants on July 21 and 22, 2023. MEASUREMENTS: We analyzed the questionnaire answers, including the system usability scale score and time of response (in 24 h). We also compared the respondents' characteristics with that of all the Japanese trial-ready cohort web study participants to identify features associated with an increased/decreased response rate to the questionnaire. RESULTS: Among the 10,112 Japanese trial-ready cohort web study participants that we sent invitation e-mails, we received 1,574 eligible responses (15.6%) within three weeks of the response acceptance period. The mean system usability scale score was 67.6, and no difference in system usability scale scores was observed in terms of age or sex. Approximately half of the respondents of the Japanese trial-ready cohort web study heard about it online, whereas one-fourth heard about it via newspapers. Contribution to drug development for dementia treatment was the most frequent motivation for participating in the Japanese trial-ready cohort web study (51.5%), followed by participation in the latest research (48.1%), concerns about self-memory (43.4%), and a family history of dementia (34.6%). Female respondents responded approximately 1.5 h later than male respondents. Lastly, those who had participated in the Japanese trial-ready cohort onsite study, were in their 70's, or had a larger number of Cognitive Function Instrument or Cogstate tests completion history were more likely to respond to the current online survey (relative risk of response > 1). CONCLUSIONS: We conducted an online survey using Google Forms for participants in the Japanese trial-ready cohort web study to determine the usability. The results of this study might help to improve the user experience of the Japanese trial-ready cohort website itself, increase the web study registrants, maintain user retention, facilitate future online surveys, and serve as a reference for other web-based registries of presymptomatic disease status.
Subject(s)
Alzheimer Disease , Internet , Registries , Humans , Cross-Sectional Studies , Male , Female , Surveys and Questionnaires , Aged , Prospective Studies , Japan , Middle AgedABSTRACT
The focus of this study, and the subject of this article, resides in the conceptually funded usability evaluation of an application of descriptive models to a specific dataset obtained from the East Slovak Institute of Heart and Vascular Diseases targeting cardiovascular patients. Delving into the current state-of-the-art practices, we examine the extent of cardiovascular diseases, descriptive data analysis models, and their practical applications. Most importantly, our inquiry focuses on exploration of usability, encompassing its application and evaluation methodologies, including Van Welie's layered model of usability and its inherent advantages and limitations. The primary objective of our research was to conceptualize, develop, and validate the usability of an application tailored to supporting cardiologists' research through descriptive modeling. Using the R programming language, we engineered a Shiny dashboard application named DESSFOCA (Decision Support System For Cardiologists) that is structured around three core functionalities: discovering association rules, applying clustering methods, and identifying association rules within predefined clusters. To assess the usability of DESSFOCA, we employed the System Usability Scale (SUS) and conducted a comprehensive evaluation. Additionally, we proposed an extension to Van Welie's layered model of usability, incorporating several crucial aspects deemed essential. Subsequently, we rigorously evaluated the proposed extension within the DESSFOCA application with respect to the extended usability model, drawing insightful conclusions from our findings.
ABSTRACT
BACKGROUND: The fastest-growing neurological disorder is Parkinson disease (PD), a progressive neurodegenerative disease that affects 10 million people worldwide. PD is typically treated with levodopa, an oral pill taken to increase dopamine levels, and other dopaminergic agonists. As the disease advances, the efficacy of the drug diminishes, necessitating adjustments in treatment dosage according to the patient's symptoms and disease progression. Therefore, remote monitoring systems that can provide more detailed and accurate information on a patient's condition regularly are a valuable tool for clinicians and patients to manage their medication. The Parkinson's Remote Interactive Monitoring System (PRIMS), developed by PragmaClin Research Inc, was designed on the premise that it will be an easy-to-use digital system that can accurately capture motor and nonmotor symptoms of PD remotely. OBJECTIVE: We performed a usability evaluation in a simulated clinical environment to assess the ease of use of the PRIMS and determine whether the product offers suitable functionality for users in a clinical setting. METHODS: Participants were recruited from a user sign-up web-based database owned by PragmaClin Research Inc. A total of 11 participants were included in the study based on the following criteria: (1) being diagnosed with PD and (2) not being diagnosed with dementia or any other comorbidities that would make it difficult to complete the PRIMS assessment safely and independently. Patient users completed a questionnaire that is based on the Movement Disorder Society-sponsored revision of the Unified Parkinson's Disease Rating Scale. Interviews and field notes were analyzed for underlying themes and topics. RESULTS: In total, 11 people with PD participated in the study (female individuals: n=5, 45%; male individuals: n=6, 55%; age: mean 66.7, SD 7.77 years). Thematic analysis of the observer's notes revealed 6 central usability issues associated with the PRIMS. These were the following: (1) the automated voice prompts are confusing, (2) the small camera is problematic, (3) the motor test exhibits excessive sensitivity to the participant's orientation and position in relation to the cameras, (4) the system poses mobility challenges, (5) navigating the system is difficult, and (6) the motor test exhibits inconsistencies and technical issues. Thematic analysis of qualitative interview responses revealed four central themes associated with participants' perspectives and opinions on the PRIMS, which were (1) admiration of purpose, (2) excessive system sensitivity, (3) video instructions preferred, and (4) written instructions disliked. The average system usability score was calculated to be 69.2 (SD 4.92), which failed to meet the acceptable system usability score of 70. CONCLUSIONS: Although multiple areas of improvement were identified, most of the participants showed an affinity for the overarching objective of the PRIMS. This feedback is being used to upgrade the current PRIMS so that it aligns more with patients' needs.
Subject(s)
Parkinson Disease , Humans , Parkinson Disease/drug therapy , Parkinson Disease/diagnosis , Male , Female , Middle Aged , Aged , User-Computer Interface , Monitoring, Physiologic/methods , Monitoring, Physiologic/instrumentationABSTRACT
Artificial intelligence (AI) chatbots, such as ChatGPT, have widely invaded all domains of human life. They have the potential to transform healthcare future. However, their effective implementation hinges on healthcare workers' (HCWs) adoption and perceptions. This study aimed to evaluate HCWs usability of ChatGPT three months post-launch in Saudi Arabia using the System Usability Scale (SUS). A total of 194 HCWs participated in the survey. Forty-seven percent were satisfied with their usage, 57 % expressed moderate to high trust in its ability to generate medical decisions. 58 % expected ChatGPT would improve patients' outcomes, even though 84 % were optimistic of its potential to improve the future of healthcare practice. They expressed possible concerns like recommending harmful medical decisions and medicolegal implications. The overall mean SUS score was 64.52, equivalent to 50 % percentile rank, indicating high marginal acceptability of the system. The strongest positive predictors of high SUS scores were participants' belief in AI chatbot's benefits in medical research, self-rated familiarity with ChatGPT and self-rated computer skills proficiency. Participants' learnability and ease of use score correlated positively but weakly. On the other hand, medical students and interns had significantly high learnability scores compared to others, while ease of use scores correlated very strongly with participants' perception of positive impact of ChatGPT on the future of healthcare practice. Our findings highlight the HCWs' perceived marginal acceptance of ChatGPT at the current stage and their optimism of its potential in supporting them in future practice, especially in the research domain, in addition to humble ambition of its potential to improve patients' outcomes particularly in regard of medical decisions. On the other end, it underscores the need for ongoing efforts to build trust and address ethical and legal concerns of AI implications in healthcare. The study contributes to the growing body of literature on AI chatbots in healthcare, especially addressing its future improvement strategies and provides insights for policymakers and healthcare providers about the potential benefits and challenges of implementing them in their practice.
ABSTRACT
In recent years, user experience (UX) has gained importance in the field of interactive systems. To ensure its success, interactive systems must be evaluated. As most of the standardized evaluation tools are dedicated to graphical user interfaces (GUIs), the evaluation of voice-based interactive systems or voice user interfaces is still in its infancy. With the help of a well-established evaluation scale, the System Usability Scale (SUS), two prominent, widely accepted voice assistants were evaluated. The evaluation, with SUS, was conducted with 16 participants who performed a set of tasks on Amazon Alexa Echo Dot and Google Nest Mini. We compared the SUS score of Amazon Alexa Echo Dot and Google Nest Mini. Furthermore, we derived the confidence interval for both voice assistants. To enhance understanding for usability practitioners, we analyzed the Adjective Rating Score of both interfaces to comprehend the experience of an interface's usability through words rather than numbers. Additionally, we validated the correlation between the SUS score and the Adjective Rating Score. Finally, a paired sample t-test was conducted to compare the SUS score of Amazon Alexa Echo Dot and Google Nest Mini. This resulted in a huge difference in scores. Hence, in this study, we corroborate the utility of the SUS in voice user interfaces and conclude by encouraging researchers to use SUS as a usability metric to evaluate voice user interfaces.
ABSTRACT
Background: The prevalence of chronic wounds is predicted to increase within the aging populations in industrialized countries. Patients experience significant distress due to pain, wound secretions, and the resulting immobilization. As the number of wounds continues to rise, their adequate care becomes increasingly costly in terms of health care resources worldwide. eHealth support systems are being increasingly integrated into patient care. However, to date, no systematic analysis of such apps for chronic wounds has been published. Objective: The aims of this study were to systematically identify and subjectively assess publicly available German- or English-language mobile apps for patients with chronic wounds, with quality assessments performed by both patients and physicians. Methods: Two reviewers independently conducted a systematic search and assessment of German- or English-language mobile apps for patients with chronic wounds that were available in the Google Play Store and Apple App Store from April 2022 to May 2022. In total, 3 apps met the inclusion and exclusion criteria and were reviewed independently by 10 physicians using the German Mobile App Rating Scale (MARS) and the System Usability Scale (SUS). The app with the highest mean MARS score was subsequently reviewed by 11 patients with chronic wounds using the German user version of the MARS (uMARS) and the SUS. Additionally, Affinity for Technology Interaction (ATI) scale scores were collected from both patients and physicians. Results: This study assessed mobile apps for patients with chronic wounds that were selected from a pool of 118 identified apps. Of the 73 apps available in both app stores, 10 were patient oriented. After excluding apps with advertisements or costs, 3 apps were evaluated by 10 physicians. Mean MARS scores ranged from 2.64 (SD 0.65) to 3.88 (SD 0.65) out of 5, and mean SUS scores ranged from 50.75 (SD 27) to 80.5 (SD 17.7) out of 100. WUND APP received the highest mean MARS score (mean 3.88, SD 0.65 out of 5) among physicians. Hence, it was subsequently assessed by 11 patients and achieved a similar rating (uMARS score: mean 3.89, SD 0.4 out of 5). Technical affinity, as measured with the ATI scale, was slightly lower in patients (score: mean 3.62, SD 1.35 out of 6) compared to physicians (score: mean 3.88, SD 1.03 out 6). Conclusions: The quality ratings from physicians and patients were comparable and indicated mediocre app quality. Technical affinity, as assessed by using the ATI scale, was slightly lower for patients. Adequate apps for patients with chronic wounds remain limited, emphasizing the need for improved app development to meet patient needs. The ATI scale proved valuable for assessing technical affinity among different user groups.
Subject(s)
Mobile Applications , Humans , Aging , Developed Countries , Language , Patient-Centered CareABSTRACT
BACKGROUND: Robotic spine surgery has continued to evolve since its US Food and Drug Administration approval in 2004, with products now including real-time video guidance and navigation during surgery. As the market for robotic surgical devices evolves, it is important to consider usability factors. OBJECTIVE: The primary objective of this study was to determine the user experience of a surgical-assistive robotic device. The secondary objective was to evaluate workload, usability, the After-Scenario Questionnaire (ASQ), and the System Usability Scale (SUS). In addition, this study compares the workload, usability, and satisfaction survey of the device among different occupational groups using the device. METHODS: Doctors (n=15) and nurses (n=15), the intended users of the surgical assistant robot, participated in the usability evaluation. Participants performed essential scenarios for the surgical assistant robot and provided scenario-specific satisfaction (ASQ), workload (NASA Task Load Index), and usability (SUS) scores. RESULTS: Both doctors and nurses had task success rates of 85% or higher for each scenario. ASQ results showed that both doctors and nurses were least satisfied with ease of completing the task of registration (group 1: mean 4.73, SD 1.57 and group 2: mean 4.47, SD 1.8), amount of time it took (group 1: mean 4.47, SD 1.63 and group 2: mean 4.40, SD 2.09), and support information satisfaction (group 1: mean 5.13, SD 1.50 and group 2: mean 5.13, SD 1.89). All participants had low workloads, and the overall Task Load Index score had a P value of .77, which is greater than .05. The SUS results showed that the overall usability mean for doctors was 64.17 (SD 16.52) and the mean for nurses was 61.67 (SD 19.18), with a P value of .84, which is greater than .05, indicating no difference between the 2 groups. CONCLUSIONS: In this study, doctors and nurses evaluated the interaction of the device in a simulated environment, the operating room. By evaluating the use experience and usability of the device with real intended users, we can develop a more effective and convenient user interface.
Subject(s)
Physicians , Robotic Surgical Procedures , Robotics , Self-Help Devices , United States , Humans , WorkloadABSTRACT
BACKGROUND: Laboratory biosafety should be a priority in all healthcare institutions. In traditional laboratory safety teaching students typically receive knowledge passively from their teachers without active involvement. The combination of experiential learning and mobile learning may provide students with greater engagement, retention, and application of knowledge. To address this issue, we developed and conducted a convergent mixed methods study to assess the feasibility and usability of a WeChat mini program (WMP) named WeMed for laboratory biosafety education for medical laboratory students at Guangzhou Medical University (GMU). METHODS: The study was conducted between November 2022 and October 2023 among second-year undergraduate students at GMU. It involved the concurrent collection, analysis, and interpretation of both qualitative and quantitative data to assess feasibility and usability. In the quantitative strand, two evaluations were conducted via online surveys from students (n = 67) after a four-week study period. The System Usability Scale (SUS) was used to evaluate usability, while self-developed questions were used to assess feasibility. Additionally, a knowledge test was administered 6 months after the program completion. In the qualitative strand, fourteen semi-structured interviews were conducted, whereby a reflexive thematic analysis was utilized to analyze the interview data. RESULTS: The overall SUS score is adequate (M = 68.17, SD = 14.39). The acceptability of the WeMed program is in the marginal high range. Most students agreed that WeMed was useful for learning biosafety knowledge and skills (13/14, 93%), while 79% (11/14) agreed it was easy to use and they intended to continue using it. After 6 months, a significant difference in the knowledge test scores was observed between the WeMed group (n = 67; 2nd year students) and the traditional training group (n = 90; 3rd year students). However, the results should be interpreted cautiously due to the absence of a pretest. CONCLUSION: The combination of experiential learning and mobile learning with WMP is a feasible tool for providing laboratory biosafety knowledge and skills. Ongoing improvements should be made in order to increase long-term acceptance.
Subject(s)
Students, Medical , Humans , Containment of Biohazards , Feasibility Studies , Universities , LearningABSTRACT
OBJECTIVE: In usability studies, the subjective component of usability, perceived usability, is often of interest besides the objective usability components, efficiency and effectiveness. Perceived usability is typically investigated using questionnaires. Our goal was to assess experimentally which of four perceived-usability questionnaires differing in length best reflects the difference in perceived usability between systems. BACKGROUND: Conventional measurement wisdom strongly favors multi-item questionnaires, as measures based on more items supposedly yield better results. However, this assumption is controversial. Single-item questionnaires also have distinct advantages and it has been shown repeatedly that single-item measures can be viable alternatives to multi-item measures. METHOD: N = 1089 (Experiment 1) and N = 1095 (Experiment 2) participants rated the perceived usability of a good or a poor web-based mobile phone contract system using the 35-item ISONORM 9241/10 (Experiment 1 only), the 10-item System Usability Scale (SUS), the 4-item Usability Metric for User Experience (UMUX), and the single-item Adjective Rating Scale. RESULTS: The Adjective Rating Scale represented the perceived-usability difference between both systems at least as good as, or significantly better than, the multi-item questionnaires (significantly better than the UMUX and the ISONORM 9241/10 in Experiment 1, significantly better than the SUS in Experiment 2). CONCLUSION: The single-item Adjective Rating Scale is a viable alternative to multi-item perceived-usability questionnaires. APPLICATION: Extremely short instruments can be recommended to measure perceived usability, at least for simple user interfaces that can be considered concrete-singular in the sense that raters understand which entity is being rated and what is being rated is reasonably homogenous.
ABSTRACT
Background Cone beam computed tomography (CBCT) has revolutionized dental and maxillofacial imaging by providing high-resolution 3D visualizations, essential for accurate diagnosis and treatment planning. Despite its clinical advancements, the usability of CBCT viewer interfaces, which play a crucial role in the effective interpretation of imaging data, remains a critical concern. Objective This study aims to evaluate the usability of a CBCT viewer interface in clinical settings, focusing on the effectiveness, efficiency, and satisfaction perspectives, to identify potential areas for improvement. Methods Twenty-two participants (N=22) were assigned the task of locating the mental foramen in a mandible dataset, selected randomly, using the multiplanar reconstruction (MPR) mode of a CBCT viewer interface on a local network. The task's effectiveness was gauged by the completion rate, while efficiency was measured through the duration of the task, the number of mouse clicks, and the cursor's path in both pixels and meters. Satisfaction or perceived usability was evaluated using the system usability scale (SUS-TR), and computer system usability questionnaire (T-CSUQ), among other scales, with participants also providing open-ended feedback. Demographic characteristics served as classification variables. Results All participants completed the given task. No demography-related differences in efficiency were observed. Perceived usability (SUS-TR: 60.68±19.58, T-CSUQ: 43.63±16.34) was below the industry standards, categorizing the system as a detractor. Commonly reported issues included accessing the MPR window, cursor behavior, and unclear error messages. The mean SUS-TR score negatively correlated with efficiency-related variables (p<0.05 for each). Conclusions The study's findings indicate that the CBCT viewer interface does not fully meet dental professionals' usability expectations, as evidenced by the task's completion rate, efficiency metrics, and below-average usability scores. Despite the successful task completion by all participants, the identified issues in interface design, such as difficulties in accessing the MPR window and unclear error messages, highlight significant areas for improvement. To enhance user satisfaction and efficiency, future developments of CBCT viewer interfaces should incorporate feedback from end-users and prioritize user-friendly design principles.
ABSTRACT
BACKGROUND: Web-based parent training (PT) programs can strengthen parent-child relationships by equipping caregivers with knowledge and evidence-based strategies to manage behavior. Hybrid facilitation of PT includes facilitator interaction paired with self-administered and web-based PT. Web-based administrative dashboards provide users (eg, administrators, facilitators, and researchers) with an integrated platform to monitor parent progress and activities within a PT program or website. Despite the utility and prevalence of administrative dashboards for web-based behavioral interventions, to our knowledge, no research studies have explored the perspectives and insights of dashboard users to enhance user experience and program delivery. OBJECTIVE: The purpose of this study is to evaluate the usability of the administrative dashboard (ezDashboard) for the ezParent program, a 6-module web-based PT program for parents of children aged 2-5 years. METHODS: This study used a descriptive, single-group design with administrators who were overseeing the implementation of the ezParent program and trained facilitators for hybrid ezParent delivery. Participants spent at least 30 minutes reviewing and evaluating the ezDashboard and then completed a survey of their experience with the dashboard. The survey included the validated 10-item System Usability Scale and open-ended questions focusing on user performance, navigation ease, and overall usefulness of the ezDashboard. RESULTS: Participants (N=15) indicated high usability of the ezDashboard with System Usability Scale scoring a total mean score of 83.5 (SD 16.3). Most participants (n=13, 87%) rated the overall user-friendliness of the ezDashboard as good (n=3, 20%), excellent (n=9, 60%), or best imaginable (n=1, 7%). Open-ended questions revealed the ezDashboard is or would be useful to monitor parent progress and trends in engagement (n=8, 53%) and for reviewing topics for discussion and communicating with parents (n=5, 33%). ezParent administrators (n=4) identified that real-time data for ezParent use helps overall management of program uptake. Suggestions for features to add to the ezDashboard included the ability to track partial progress of program modules (4/14, 29%), total time spent per module (2/14, 14%), and exportable reports (4/14, 29%). Other ideas for improvement included direct messaging capabilities, videoconferencing platform integration, and being able to modify participant account and contact information. CONCLUSIONS: Results indicate that the ezDashboard is easy to use and provides functional information to facilitators and administrators in delivering ezParent. Qualitative results indicate that integrating suggested features into the ezDashboard may help provide a smoother experience for facilitators, administrators, and ultimately the parents using the program. Providing resources for facilitators and administrators in real time to monitor intervention participants' progress in a program can be helpful in tracking progress and providing facilitated support in tailoring program content and program completion.
ABSTRACT
INTRODUCTION: The STRYKER ADAPT computer-assisted navigation system provides intraoperative feedback to the surgeon regarding implant placement of the Gamma3 nail. The usability of the ADAPT system has not been evaluated. The aim of the study was to investigate the perceived usability of the ADAPT system. MATERIALS AND METHODS: This was a descriptive study with prospectively collected data. ADAPT was introduced at Aarhus University Hospital in February 2021. Prior to introduction, surgeons at the department attended a general introduction to the system. ADAPT was introduced to the surgical nurses and was on display at the surgical ward at more than one occasion, where personal introduction to the system was possible. After introduction, it was mandatory to use ADAPT when using the Gamma3 nail to treat intertrochanteric femur fractures. After each procedure, primary and an eventual supervisor answered a questionnaire, which encompassed the System Usability Scale (SUS) questionnaire. The SUS is a ten-item questionnaire regarding the perceived usability of a system. SUS scores were translated to adjectives, describing user experience on a 7-point adjective scale (worst imaginable, awful, poor, ok, good, excellent, best imaginable). User acceptability, defined as "not acceptable", "marginal" or "acceptable", was also used to interpret the SUS scores. RESULTS: ADAPT was used in 50 procedures by 29 different surgeons, with varying skill-level. Median SUS-score after first-time use of ADAPT for all 29 surgeons was 43 (range: 5-60), which translated to "poor" or "not acceptable". For surgeons who performed ≥ 3 ADAPT-assisted procedures, there were no statistically significant difference in their first to latest SUS-score (median difference: 4.3, p = 0.5). In free text comments ADAPT was positively described as helpful in placement of K-wire and providing educational opportunities for inexperienced surgeons and negatively as inconsistent, slow, time consuming, and causing excessive fluoroscopy. CONCLUSIONS: Usability and acceptability of ADAPT was rated as "poor" or "not acceptable" by the majority of operating surgeons. ADAPT has not been used at our institution based on these findings. The System Usability Scale may be used in further research exploring usability and acceptability of novel computer-assisted navigation systems for orthopaedic surgery.