Smart Web-Based Platform to Support Physical Rehabilitation.

The enhancement of ubiquitous and pervasive computing brings new perspectives in medical rehabilitation. In that sense, the present study proposes a smart, web-based platform to promote the reeducation of patients after hip replacement surgery. This project focuses on two fundamental aspects in the development of a suitable tele-rehabilitation application, which are: (i) being based on an affordable technology, and (ii) providing the patients with a real-time assessment of the correctness of their movements. A probabilistic approach based on the development and training of ten Hidden Markov Models (HMMs) is used to discriminate in real time the main faults in the execution of the therapeutic exercises. Two experiments are designed to evaluate the precision of the algorithm for classifying movements performed in the laboratory and clinical settings, respectively. A comparative analysis of the data shows that the models are as reliable as the physiotherapists to discriminate and identify the motion errors. The results are discussed in terms of the required setup for a successful application in the field and further implementations to improve the accuracy and usability of the system.

Use of natural user interfaces for image navigation during laparoscopic surgery: initial experience.

BACKGROUND: Surgical environments require special aseptic conditions for direct interaction with the preoperative images. We aim to test the feasibility of using a set of gesture control sensors combined with voice control to interact in a sterile manner with preoperative information and an integrated operating room (OR) during laparoscopic surgery. MATERIAL AND METHODS: Two hepatectomies and two partial nephrectomies were performed by three experienced surgeons in a porcine model. The Kinect, Leap Motion, and MYO armband in combination with voice control were used as natural user interfaces (NUIs). After surgery, surgeons completed a questionnaire about their experience. RESULTS: Surgeons required <10 min training with each NUI. They stated that NUIs improved the access to preoperative patient information and kept them more focused on the surgical site. The Kinect system was reported as the most physically demanding NUI and the MYO armband in combination with voice commands as the most intuitive and accurate. The need to release one of the laparoscopic instruments in order to use the NUIs was identified as the main limitation. CONCLUSIONS: The presented NUIs are feasible to directly interact in a more intuitive and sterile manner with the preoperative images and the integrated OR functionalities during laparoscopic surgery.

Development of an Eye-Tracking Image Manipulation System for Angiography: A Comparative Study.

RATIONALE AND OBJECTIVES: Appropriate image manipulation of angiographic image display systems during interventional radiology is performed by radiological technologists and/or nurses given instructions from radiologists. However, appropriate images might not be displayed because of communication errors. Therefore, we developed a manipulation system that uses an eye tracker. The study aimed to determine if an angiographic image display system can be manipulated as well by using an eye tracker as by using a mouse. MATERIALS AND METHODS: An angiographic image display system using an eye tracker to calculate the gaze position on the screen and state of fixation was developed. Fourteen radiological technologists participated in an observer study by manipulating 10 images for each of 5 typical cases frequently performed in angiography, such as renal tumor, cerebral aneurysm, liver tumor, uterine bleeding, and hypersplenism. We measured the time from the start to the end of manipulating a series of images required when using the eye tracker and the conventional mouse. In this study, the statistical processing was done using Excel and R and R studio. RESULTS: The average time required for all observers for completing all cases was significantly shorter when using the eye tracker than when using the mouse (10.4 ± 2.1 s and 16.9 ± 2.6 s, respectively; p< 0.001 by paired t test). CONCLUSION: Radiologists were able to manipulate an angiographic image display system directly by using the newly developed eye tracker system without touching contact devices, such as a mouse or angiography console. Therefore, communication error could be avoided.

A comparison of natural user interface and graphical user interface for narrative in HMD-based augmented reality.

Over the years, the various mediums available for storytelling have progressively expanded, from spoken to written word, then to film, and now to Virtual Reality (VR) and Augmented Reality (AR). In 2016, the cutting-edge Head-Mounted Display (HMD) AR Microsoft HoloLens was released. However, though it has been several years, the quality of the user experience with narration using HMD-based AR technology has been rarely discussed. The present study explored interactive narrative in HMD-based AR regarding different user interfaces and their influence on users' presence, narrative engagement and reflection. Inspired by an existing exhibition at the National Holocaust Centre and Museum in the U.K., a HoloLens narrative application, entitled The AR Journey, was developed by the authors using two different interaction methods, Natural User Interface (NUI) and Graphical User Interface (GUI), which were used to perform an empirical study. As revealed from the results of the between-subject design experiment, NUI exhibited statistically significant advantages in creating presence for users without 3D Role Playing Game (RPG) experience, and GUI was superior in creating presence and increasing narrative engagement for users with 3D RPG experience. As indicated by the results of the interviews, the overall narrative experience in HMD-based AR was acceptable, and the branching narrative design was engaging. However, HoloLens hardware issues, as well as virtuality and reality mismatch, adversely affected user experience. Design guidelines were proposed according to the qualitative results. SUPPLEMENTARY INFORMATION: The online version contains supplementary material available at 10.1007/s11042-021-11723-0.

Evaluating Voice Assistants' Responses to COVID-19 Vaccination in Portuguese: Quality Assessment.

BACKGROUND: Voice assistants (VAs) are devices that respond to human voices and can be commanded to do a variety of tasks. Nowadays, VAs are being used to obtain health information, which has become a critical point of analysis for researchers in terms of question understanding and quality of response. Particularly, the COVID-19 pandemic has and still is severely affecting people worldwide, which demands studies on how VAs can be used as a tool to provide useful information. OBJECTIVE: This work aimed to perform a quality analysis of different VAs' responses regarding the actual and important subject of COVID-19 vaccines. We focused on this important subject since vaccines are now available and society has urged for the population to be rapidly immunized. METHODS: The proposed study was based on questions that were collected from the official World Health Organization website. These questions were submitted to the 5 dominant VAs (Alexa, Bixby, Cortana, Google Assistant, and Siri), and responses were evaluated according to a rubric based on the literature. We focused this study on the Portuguese language as an additional contribution, since previous works are mainly focused on the English language, and we believe that VAs cannot be optimized to foreign languages. RESULTS: Results showed that Google Assistant has a better overall performance, and only this VA and Samsung Bixby achieved high scores on question understanding in the Portuguese language. Regarding the obtained answers, the study also showed the best Google Assistant overall performance. CONCLUSIONS: Under the urgent context of COVID-19 vaccination, this work can help to understand how VAs must be improved to be more useful to the society and how careful people must be when considering VAs as a source of health information. VAs have been demonstrated to perform well regarding comprehension and user-friendliness. However, this work has found that they must be better integrated to their information sources to be useful as health information tools.

Head-tracking as an interface device for image control in digital pathology: a comparative study.

BACKGROUND: Inasmuch as the conventional mouse is not an ideal input device for digital pathology, the aim of this study was to evaluate alternative systems with the goal of identifying a natural user interface (NUI) for controlling whole slide images (WSI). DESIGN: Four pathologists evaluated three webcam-based, head-tracking mouse emulators: Enable Viacam (eViacam, CREA Software), Nouse (JLG Health Solutions Inc), and Camera Mouse (CM Solutions Inc). Twenty WSI dermatopathological cases were randomly selected and examined with Image Viewer (Ventana, AZ, USA). The NASA-TLX was used to rate the perceived workload of using these systems and time was recorded. In addition, a satisfaction survey was used. RESULTS: The mean total time needed for diagnosis with Camera Mouse, eViacam, and Nouse was 18'57", 19'37" and 22'32", respectively (57/59/68seconds per case, respectively). The NASA-TLX workload score, where lower scores are better, was 42.1 for eViacam, 53.3 for Nouse and 60.62 for Camera Mouse. This correlated with the pathologists' degree of satisfaction on a scale of 1-5: 3.4 for eViacam, 3 for Nouse, and 2 for Camera Mouse (p<0.05). CONCLUSIONS: Head-tracking systems enable pathologists to control the computer cursor and virtual slides without their hands using only a webcam as an input device. - Of the three software solutions examined, eViacam seems to be the best of those evaluated in this study, followed by Nouse and, finally, Camera Mouse. - Further studies integrating other systems should be performed in conjunction with software developments to identify the ideal device for digital pathology.

Augmented rotations in virtual reality for users with a reduced range of head movement.

INTRODUCTION: A large body of research in the field of virtual reality is focused on making user interfaces more natural and intuitive by leveraging natural body movements to explore a virtual environment. For example, head-tracked user interfaces allow users to naturally look around a virtual space by moving their head. However, such approaches may not be appropriate for users with temporary or permanent limitations of their head movement. METHODS: In this paper, we present techniques that allow these users to get virtual benefits from a reduced range of physical movements. Specifically, we describe two techniques that augment virtual rotations relative to physical movement thresholds. RESULTS: We describe how each of the two techniques can be implemented with either a head tracker or an eye tracker, e.g. in cases when no physical head rotations are possible. CONCLUSIONS: We discuss their differences and limitations and we provide guidelines for the practical use of such augmented user interfaces.

Visualização imersiva e interação gestual com dados médicos / Immersive visualization and gestural interaction withmMedical data

As tecnologias de Realidade Virtual vêm se desenvolvendo bastante nos últimos anos e com elas a sua utilização em diversas áreas, dentre as quais, a medicina. Testes, treinamentos, e alguns tipos de tratamento que seriam complicados de serem ser feitos com abordagens tradicionais agora podem ser produzidos graças aos elementos disponíveis nas tecnologias de realidade virtual. OBJETIVO: Propor uma ferramenta de visualização volumétrica em realidade virtual que possua interação gestual e ferramentas de segmentação de imagens e que facilite o processo de análise de dados médicos. MÉTODOS: Aquisição das imagens, geração dos dados volumétricos, desenvolvimento das ferramentas de interação e desenvolvimento da interface gestual. RESULTADOS: O sistema obteve êxito na geração e visualização de dados médicos tendo bom desempenho em testes realizados na avaliação de usabilidade de sua interface gestual. CONCLUSÃO: O sistemas e mostra como uma promissora alternativa para a visualização de dados médicos em realidade virtual.

The Virtual Reality technologies have been developing greatly in recent years and with them their use in various fields, among which the medicine. Some testings, trainings, and some types of treatments that would be complicated to be made with traditional approaches can now be produced thanks to the elements available in the virtual reality technologies. OBJECTIVE: To propose a volume visualization tool in virtual reality that has gestural interaction and image segmentation tools and facilitates the process of analysis of medical data. METHODS: Image acquisition volumetric data generation, development of the interaction tools and development of the gestural interface. RESULTS: The system was successful in the generation and visualization of medical data, having good performance in usability tests of its gestural interface. CONCLUSION: The system is a promising alternative for viewing medical data in virtual reality.

Validación de movimientos de coordinación en extremidades superiores para rehabilitación virtual usando pendientes lineales / Validation coordinating movements in upper limbs for virtual rehabilitation using using slopes

El desarrollo del presente trabajo se fundamenta en la importancia de apoyar los tratamientos de Rehabilitación Motriz por medio de Tecnología Informática para beneficio de los pacientes y especialistas del área. De acuerdo a un análisis realizado de las tecnologías existentes para la Rehabilitación Motriz, se ha identificado una serie de inconvenientes que limitan su uso en algunos tratamientos y por consecuencia los pacientes no continúan o no finalizan sus terapias, en este trabajo se propone emplear una herramienta de bajo costo (sensor Microsoft Kinect) que apoye en la captura de movimientos de los puntos clave de las extremidades superiores (manos, codos y hombros) usando pendientes lineales. Así mismo, se han realizado una serie de pruebas a 21 usuarios, en donde se evaluaron sus movimientos mediante umbrales que determinaron si un ejercicio fue realizado correctamente(AU)

The development of this researckneh is based on supporting Motor Rehabilitation treatments using Information Technology for the benefit of patients and specialists in the area. According to an analysis of current technologies for Motor Rehabilitation, we have identified some disadvantages that limit their use in the treatment and therefore patients do not continue or complete their therapies, this study intends to use a tool low cost (Microsoft Kinect sensor) to support the motion capture of the key points of the upper extremities (hands, elbows and shoulders) using a slopes. Also, the tests were conducted with 21 users, the algorithm evaluated some movements, the thresholds used determined the correct exercises(AU)