The Reconstructive Metaverse - Collaboration in Real-Time Shared Mixed Reality Environments for Microsurgical Reconstruction.

Plastic surgeons routinely use 3D-models in their clinical practice, from 3D-photography and surface imaging to 3D-segmentations from radiological scans. However, these models continue to be viewed on flattened 2D screens that do not enable an intuitive understanding of 3D-relationships and cause challenges regarding collaboration with colleagues. The Metaverse has been proposed as a new age of applications building on modern Mixed Reality headset technology that allows remote collaboration on virtual 3D-models in a shared physical-virtual space in real-time. We demonstrate the first use of the Metaverse in the context of reconstructive surgery, focusing on preoperative planning discussions and trainee education. Using a HoloLens headset with the Microsoft Mesh application, we performed planning sessions for 4 DIEP-flaps in our reconstructive metaverse on virtual patient-models segmented from routine CT angiography. In these sessions, surgeons discuss perforator anatomy and perforator selection strategies whilst comprehensively assessing the respective models. We demonstrate the workflow for a one-on-one interaction between an attending surgeon and a trainee in a video featuring both viewpoints as seen through the headset. We believe the Metaverse will provide novel opportunities to use the 3D-models that are already created in everyday plastic surgery practice in a more collaborative, immersive, accessible, and educational manner.

HoloDIEP-Faster and More Accurate Intraoperative DIEA Perforator Mapping Using a Novel Mixed Reality Tool.

BACKGROUND: Microsurgical breast reconstruction using abdominal tissue is a complex procedure, in part, due to variable vascular/perforator anatomy. Preoperative computed tomography angiography (CTA) has mitigated this challenge to some degree; yet it continues to pose certain challenges. The ability to map perforators with Mixed Reality has been demonstrated in case studies, but its accuracy has not been studied intraoperatively. Here, we compare the accuracy of "HoloDIEP" in identifying perforator location (vs. Doppler ultrasound) by using holographic 3D models derived from preoperative CTA. METHODS: Using a custom application on HoloLens, the deep inferior epigastric artery vascular tree was traced in 15 patients who underwent microsurgical breast reconstruction. Perforator markings were compared against the 3D model in a coordinate system centered on the umbilicus. Holographic- and Doppler-identified markings were compared using a perspective-corrected photo technique against the 3D model along with measurement of duration of perforator mapping for each technique. RESULTS: Vascular points in HoloDIEP skin markings were -0.97 ± 6.2 mm (perforators: -0.62 ± 6.13 mm) away from 3D-model ground-truth in radial length from the umbilicus at a true distance of 10.81 ± 6.14 mm (perforators: 11.40 ± 6.15 mm). Absolute difference in radial distance was twice as high for Doppler markings compared with Holo-markings (9.71 ± 6.16 and 4.02 ± 3.20 mm, respectively). Only in half of all cases (7/14), more than 50% of the Doppler-identified points were reasonably close (<30 mm) to 3D-model ground-truth. HoloDIEP was twice as fast as Doppler ultrasound (76.9s vs. 150.4 s per abdomen). CONCLUSION: HoloDIEP allows for faster and more accurate intraoperative perforator mapping than Doppler ultrasound.

3D Printing for the Development of Palatal Defect Prosthetics.

Background: Three-dimensional (3D) printing has emerged as a promising new technology for the development of surgical prosthetics. Research in orthopedic surgery has demonstrated that using 3D printed customized prosthetics results in more precise implant placements and better patient outcomes. However, there has been little research on implementing customized 3D printed prosthetics in otolaryngology. The program sought to determine whether computed tomography (CT) serves as feasible templates to construct 3D printed palatal obturator prosthetics for defects in patients who have been treated for head and neck cancers. Observations: A retrospective review of patients with palatal defects was conducted and identified 1 patient with high quality CTs compatible with 3D modeling. CTs of the patient's craniofacial anatomy were used to develop a 3D model and a Formlabs 3B+ printer printed the palatal prosthetic. We successfully developed and produced an individualized prosthetic using CTs from a veteran with head and neck deformities caused by cancer treatment who was previously treated at the Veterans Affairs Palo Alto Health Care System. This project was successful in printing patient-specific implants using CT reproductions of the patient's craniofacial anatomy, particularly of the palate. The program was a proof of concept and the implant we created was not used on the patient. Conclusions: Customized 3D printed implants may allow otolaryngologists to enhance the performance and efficiency of surgeries and better rehabilitate and reconstruct craniofacial deformities to restore appearance and function to patients. Additional research will strive to enhance the therapeutic potential of these prosthetics to serve as low-cost, patient-specific implants.

Suture Packaging as a Marker for Intraoperative Image Alignment in Augmented Reality on Mobile Devices.

Preoperative vascular imaging has become standard practice in the planning of microsurgical breast reconstruction. Currently, translating perforator locations from radiological findings to a patient's abdomen is often not easy or intuitive. Techniques using three-dimensional printing or patient-specific guides have been introduced to superimpose anatomy onto the abdomen for reference. Augmented and mixed reality is currently actively investigated for perforator mapping by superimposing virtual models directly onto the patient. Most techniques have found only limited adoption due to complexity and price. Additionally, a critical step is aligning virtual models to patients. We propose repurposing suture packaging as an image tracking marker. Tracking markers allow quick and easy alignment of virtual models to the individual patient's anatomy. Current techniques are often complicated or expensive and limit intraoperative use of augmented reality models. Suture packs are sterile, readily available, and can be used to align abdominal models on the patients. Using an iPad, the augmented reality models automatically align in the correct position by using a suture pack as a tracking marker. Given the ubiquity of iPads, the combination of these devices with readily available suture packs will predictably lower the barrier to entry and utilization of this technology. Here, our workflow is presented along with its intraoperative utilization. Additionally, we investigated the accuracy of this technology.

Leveraging the Apple Ecosystem: Easy Viewing and Sharing of Three-dimensional Perforator Visualizations via iPad/iPhone-based Augmented Reality.

We introduce a novel technique using augmented reality (AR) on smartphones and tablets, making it possible for surgeons to review perforator anatomy in three dimensions on the go. Autologous breast reconstruction with abdominal flaps remains challenging due to the highly variable anatomy of the deep inferior epigastric artery. Computed tomography angiography has mitigated some but not all challenges. Previously, volume rendering and different headsets were used to enable better three-dimensional (3D) review for surgeons. However, surgeons have been dependent on others to provide 3D imaging data. Leveraging the ubiquity of Apple devices, our approach permits surgeons to review 3D models of deep inferior epigastric artery anatomy segmented from abdominal computed tomography angiography directly on their iPhone/iPad. Segmentation can be performed in common radiology software. The models are converted to the universal scene description zipped format, which allows immediate use on Apple devices without third-party software. They can be easily shared using secure, Health Insurance Portability and Accountability Act-compliant sharing services already provided by most hospitals. Surgeons can simply open the file on their mobile device to explore the images in 3D using "object mode" natively without additional applications or can switch to AR mode to pin the model in their real-world surroundings for intuitive exploration. We believe patient-specific 3D anatomy models are a powerful tool for intuitive understanding and communication of complex perforator anatomy and would be a valuable addition in routine clinical practice and education. Using this one-click solution on existing devices that is simple to implement, we hope to streamline the adoption of AR models by plastic surgeons.

Increasing DIEA Perforator Detail in Three-Dimensional Photorealistic Volume-Rendering Visualizations.

SUMMARY: Preoperative computed tomographic angiography is increasingly performed before perforator flap-based reconstruction. However, radiologic two-dimensional thin slices do not allow for intuitive interpretation and translation to intraoperative findings. Three-dimensional volume rendering has been used to alleviate the need for mental two-dimensional to three-dimensional abstraction. Even though volume rendering allows for a much easier understanding of anatomy, it currently has limited utility, as the skin obstructs the view of critical structures. Using free, open-source software, the authors introduce a new skin-masking technique that allows surgeons to easily create a segmentation mask of the skin that can later be used to toggle the skin on and off. In addition, the mask can be used in other rendering applications. The authors use Cinematic Anatomy for photorealistic volume rendering and interactive exploration of computed tomographic angiography with and without skin. The authors present results from using this technique to investigate perforator anatomy in deep inferior epigastric perforator flaps and demonstrate that the skin-masking workflow is performed in less than 5 minutes. In Cinematic Anatomy, the view onto the abdominal wall and especially onto perforators becomes significantly sharper and more detailed when no longer obstructed by the skin. The authors perform a virtual, partial muscle dissection to show the intramuscular and submuscular course of the perforators. The skin-masking workflow allows surgeons to improve arterial and perforator detail in volume renderings easily and quickly by removing skin and could alternatively be performed solely using open-source and free software. The workflow can be easily expanded to other perforator flaps without the need for modification.

On the impact of vessel wall stiffness on quantitative flow dynamics in a synthetic model of the thoracic aorta.

Aortic wall stiffening is a predictive marker for morbidity in hypertensive patients. Arterial pulse wave velocity (PWV) correlates with the level of stiffness and can be derived using non-invasive 4D-flow magnetic resonance imaging (MRI). The objectives of this study were twofold: to develop subject-specific thoracic aorta models embedded into an MRI-compatible flow circuit operating under controlled physiological conditions; and to evaluate how a range of aortic wall stiffness impacts 4D-flow-based quantification of hemodynamics, particularly PWV. Three aorta models were 3D-printed using a novel photopolymer material at two compliant and one nearly rigid stiffnesses and characterized via tensile testing. Luminal pressure and 4D-flow MRI data were acquired for each model and cross-sectional net flow, peak velocities, and PWV were measured. In addition, the confounding effect of temporal resolution on all metrics was evaluated. Stiffer models resulted in increased systolic pressures (112, 116, and 133 mmHg), variations in velocity patterns, and increased peak velocities, peak flow rate, and PWV (5.8-7.3 m/s). Lower temporal resolution (20 ms down to 62.5 ms per image frame) impacted estimates of peak velocity and PWV (7.31 down to 4.77 m/s). Using compliant aorta models is essential to produce realistic flow dynamics and conditions that recapitulated in vivo hemodynamics.

The utility of three-dimensional models in complex microsurgical reconstruction.

BACKGROUND: Three-dimensional (3D) model printing improves visualization of anatomical structures in space compared to two-dimensional (2D) data and creates an exact model of the surgical site that can be used for reference during surgery. There is limited evidence on the effects of using 3D models in microsurgical reconstruction on improving clinical outcomes. METHODS: A retrospective review of patients undergoing reconstructive breast microsurgery procedures from 2017 to 2019 who received computed tomography angiography (CTA) scans only or with 3D models for preoperative surgical planning were performed. Preoperative decision-making to undergo a deep inferior epigastric perforator (DIEP) versus muscle-sparing transverse rectus abdominis myocutaneous (MS-TRAM) flap, as well as whether the decision changed during flap harvest and postoperative complications were tracked based on the preoperative imaging used. In addition, we describe three example cases showing direct application of 3D mold as an accurate model to guide intraoperative dissection in complex microsurgical reconstruction. RESULTS: Fifty-eight abdominal-based breast free-flaps performed using conventional CTA were compared with a matched cohort of 58 breast free-flaps performed with 3D model print. There was no flap loss in either group. There was a significant reduction in flap harvest time with use of 3D model (CTA vs. 3D, 117.7±14.2 minutes vs. 109.8±11.6 minutes; P=0.001). In addition, there was no change in preoperative decision on type of flap harvested in all cases in 3D print group (0%), compared with 24.1% change in conventional CTA group. CONCLUSIONS: Use of 3D print model improves accuracy of preoperative planning and reduces flap harvest time with similar postoperative complications in complex microsurgical reconstruction.

3-DIEPrinting: 3D-printed Models to Assist the Intramuscular Dissection in Abdominally Based Microsurgical Breast Reconstruction.

Harvest of the deep inferior epigastric vessels for microsurgical breast reconstruction can be complicated by an intricate and lengthy subfascial dissection. Although multiple preoperative imaging modalities exist to help visualize the vascular anatomy and assist in perforator selection, few can help clearly define the intramuscular course of these vessels. The authors introduce their early experience with 3D-printed anatomical modeling (to-scale) of the infraumbilical course of the deep inferior epigastric subfascial vascular tree to better assist in executing the intramuscular dissection.