RESUMO
BACKGROUND: As an integral part of computer-assisted surgery, virtual surgical planning (VSP) leads to significantly better surgery results, such as for oral and maxillofacial reconstruction with microvascular grafts of the fibula or iliac crest. It is performed on a 2D computer desktop screen (DS) based on preoperative medical imaging. However, in this environment, VSP is associated with shortcomings, such as a time-consuming planning process and the requirement of a learning process. Therefore, a virtual reality (VR)-based VSP application has great potential to reduce or even overcome these shortcomings due to the benefits of visuospatial vision, bimanual interaction, and full immersion. However, the efficacy of such a VR environment has not yet been investigated. OBJECTIVE: This study aimed to demonstrate the possible advantages of a VR environment through a substep of VSP, specifically the segmentation of the fibula (calf bone) and os coxae (hip bone), by conducting a training course in both DS and VR environments and comparing the results. METHODS: During the training course, 6 novices were taught how to use a software application in a DS environment (3D Slicer) and in a VR environment (Elucis) for the segmentation of the fibula and os coxae, and they were asked to carry out the maneuvers as accurately and quickly as possible. Overall, 13 fibula and 13 os coxae were segmented for each participant in both methods (VR and DS), resulting in 156 different models (78 fibula and 78 os coxae) per method (VR and DS) and 312 models in total. The individual learning processes in both environments were compared using objective criteria (time and segmentation performance) and self-reported questionnaires. The models resulting from the segmentation were compared mathematically (Hausdorff distance and Dice coefficient) and evaluated by 2 experienced radiologists in a blinded manner. RESULTS: A much faster learning curve was observed for the VR environment than the DS environment (ß=.86 vs ß=.25). This nearly doubled the segmentation speed (cm3/min) by the end of training, leading to a shorter time (P<.001) to reach a qualitative result. However, there was no qualitative difference between the models for VR and DS (P=.99). The VR environment was perceived by participants as more intuitive and less exhausting, and was favored over the DS environment. CONCLUSIONS: The more rapid learning process and the ability to work faster in the VR environment could save time and reduce the VSP workload, providing certain advantages over the DS environment.
RESUMO
BACKGROUND: Although nearly one-third of the world's disease burden requires surgical care, only a small proportion of digital health applications are directly used in the surgical field. In the coming decades, the application of augmented reality (AR) with a new generation of optical-see-through head-mounted displays (OST-HMDs) like the HoloLens (Microsoft Corp) has the potential to bring digital health into the surgical field. However, for the application to be performed on a living person, proof of performance must first be provided due to regulatory requirements. In this regard, cadaver studies could provide initial evidence. OBJECTIVE: The goal of the research was to develop an open-source system for AR-based surgery on human cadavers using freely available technologies. METHODS: We tested our system using an easy-to-understand scenario in which fractured zygomatic arches of the face had to be repositioned with visual and auditory feedback to the investigators using a HoloLens. Results were verified with postoperative imaging and assessed in a blinded fashion by 2 investigators. The developed system and scenario were qualitatively evaluated by consensus interview and individual questionnaires. RESULTS: The development and implementation of our system was feasible and could be realized in the course of a cadaver study. The AR system was found helpful by the investigators for spatial perception in addition to the combination of visual as well as auditory feedback. The surgical end point could be determined metrically as well as by assessment. CONCLUSIONS: The development and application of an AR-based surgical system using freely available technologies to perform OST-HMD-guided surgical procedures in cadavers is feasible. Cadaver studies are suitable for OST-HMD-guided interventions to measure a surgical end point and provide an initial data foundation for future clinical trials. The availability of free systems for researchers could be helpful for a possible translation process from digital health to AR-based surgery using OST-HMDs in the operating theater via cadaver studies.
RESUMO
Over 10 years' experience with VR displays, visualization applications, and informal feedback from scientists using these applications has convinced RWTH Aachen University researchers that the combination of full immersion, high image quality, and advanced interaction metaphors makes immersive visualization valuable as an analysis tool in simulation science.
