User Experience Evaluation of a Spinal Surgery Robot: Workload, Usability, and Satisfaction Study.

BACKGROUND: Robotic spine surgery has continued to evolve since its US Food and Drug Administration approval in 2004, with products now including real-time video guidance and navigation during surgery. As the market for robotic surgical devices evolves, it is important to consider usability factors. OBJECTIVE: The primary objective of this study was to determine the user experience of a surgical-assistive robotic device. The secondary objective was to evaluate workload, usability, the After-Scenario Questionnaire (ASQ), and the System Usability Scale (SUS). In addition, this study compares the workload, usability, and satisfaction survey of the device among different occupational groups using the device. METHODS: Doctors (n=15) and nurses (n=15), the intended users of the surgical assistant robot, participated in the usability evaluation. Participants performed essential scenarios for the surgical assistant robot and provided scenario-specific satisfaction (ASQ), workload (NASA Task Load Index), and usability (SUS) scores. RESULTS: Both doctors and nurses had task success rates of 85% or higher for each scenario. ASQ results showed that both doctors and nurses were least satisfied with ease of completing the task of registration (group 1: mean 4.73, SD 1.57 and group 2: mean 4.47, SD 1.8), amount of time it took (group 1: mean 4.47, SD 1.63 and group 2: mean 4.40, SD 2.09), and support information satisfaction (group 1: mean 5.13, SD 1.50 and group 2: mean 5.13, SD 1.89). All participants had low workloads, and the overall Task Load Index score had a P value of .77, which is greater than .05. The SUS results showed that the overall usability mean for doctors was 64.17 (SD 16.52) and the mean for nurses was 61.67 (SD 19.18), with a P value of .84, which is greater than .05, indicating no difference between the 2 groups. CONCLUSIONS: In this study, doctors and nurses evaluated the interaction of the device in a simulated environment, the operating room. By evaluating the use experience and usability of the device with real intended users, we can develop a more effective and convenient user interface.

Usability Study on Patient Monitoring Systems: An Evaluation of a User Interface Based on User Experience and Preference.

BACKGROUND The poor ergonomic design of patient monitoring systems can cause user errors and patient harm. This paper presents the results of a comparative usability study based on user experience and the results of a user preference survey. MATERIAL AND METHODS We conducted a usability study of 3 patient monitoring systems: Mediana M50, Philips IntelliVue MP70, and Philips IntelliVue MX700. Thirty-nine Coronary Care Unit nurses and 19 Pulmonology and Allergy Care Unit nurses participated in this usability study. User experience was assessed with the Post-Study System Usability Questionnaire and the National Aeronautics and Space Administration Task Load Index. A user preference survey was conducted to evaluate the subjective medical device design preferences for the M50 system's user interface. RESULTS Nurses from the Coronary Care Unit recognized a higher system usability for the MP70 than the M50 (P=0.001) system, and a lower workload for the MP70 compared with the M50 (P=0.005) system. There was no significant (P>0.05) difference in perceived system usability and workload between the M50 and MX700 systems for the nurses from the Pulmonology and Allergy Care Unit. Nurses preferred to activate the arrhythmia alarms except for the ST alarms and missed the beat alarm. They also preferred having a wave freeze function, standby mode, and early warning scoring function, which provides a signal for a patient's deterioration in health. CONCLUSIONS The study provides valuable data on a user interface evaluation based on user experience and preference. The outcome of this study will be helpful for designing next-generation patient monitors with improved patient safety.