HoloLens 1 vs. HoloLens 2: Improvements in the New Model for Orthopedic Oncological Interventions.

This work analyzed the use of Microsoft HoloLens 2 in orthopedic oncological surgeries and compares it to its predecessor (Microsoft HoloLens 1). Specifically, we developed two equivalent applications, one for each device, and evaluated the augmented reality (AR) projection accuracy in an experimental scenario using phantoms based on two patients. We achieved automatic registration between virtual and real worlds using patient-specific surgical guides on each phantom. They contained a small adaptor for a 3D-printed AR marker, the characteristic patterns of which were easily recognized using both Microsoft HoloLens devices. The newest model improved the AR projection accuracy by almost 25%, and both of them yielded an RMSE below 3 mm. After ascertaining the enhancement of the second model in this aspect, we went a step further with Microsoft HoloLens 2 and tested it during the surgical intervention of one of the patients. During this experience, we collected the surgeons' feedback in terms of comfortability, usability, and ergonomics. Our goal was to estimate whether the improved technical features of the newest model facilitate its implementation in actual surgical scenarios. All of the results point to Microsoft HoloLens 2 being better in all the aspects affecting surgical interventions and support its use in future experiences.

Augmented Reality as a Tool to Guide PSI Placement in Pelvic Tumor Resections.

Patient-specific instruments (PSIs) have become a valuable tool for osteotomy guidance in complex surgical scenarios such as pelvic tumor resection. They provide similar accuracy to surgical navigation systems but are generally more convenient and faster. However, their correct placement can become challenging in some anatomical regions, and it cannot be verified objectively during the intervention. Incorrect installations can result in high deviations from the planned osteotomy, increasing the risk of positive resection margins. In this work, we propose to use augmented reality (AR) to guide and verify PSIs placement. We designed an experiment to assess the accuracy provided by the system using a smartphone and the HoloLens 2 and compared the results with the conventional freehand method. The results showed significant differences, where AR guidance prevented high osteotomy deviations, reducing maximal deviation of 54.03 mm for freehand placements to less than 5 mm with AR guidance. The experiment was performed in two versions of a plastic three-dimensional (3D) printed phantom, one including a silicone layer to simulate tissue, providing more realism. We also studied how differences in shape and location of PSIs affect their accuracy, concluding that those with smaller sizes and a homogeneous target surface are more prone to errors. Our study presents promising results that prove AR's potential to overcome the present limitations of PSIs conveniently and effectively.

Real-Time Tool Detection for Workflow Identification in Open Cranial Vault Remodeling.

Deep learning is a recent technology that has shown excellent capabilities for recognition and identification tasks. This study applies these techniques in open cranial vault remodeling surgeries performed to correct craniosynostosis. The objective was to automatically recognize surgical tools in real-time and estimate the surgical phase based on those predictions. For this purpose, we implemented, trained, and tested three algorithms based on previously proposed Convolutional Neural Network architectures (VGG16, MobileNetV2, and InceptionV3) and one new architecture with fewer parameters (CranioNet). A novel 3D Slicer module was specifically developed to implement these networks and recognize surgical tools in real time via video streaming. The training and test data were acquired during a surgical simulation using a 3D printed patient-based realistic phantom of an infant's head. The results showed that CranioNet presents the lowest accuracy for tool recognition (93.4%), while the highest accuracy is achieved by the MobileNetV2 model (99.6%), followed by VGG16 and InceptionV3 (98.8% and 97.2%, respectively). Regarding phase detection, InceptionV3 and VGG16 obtained the best results (94.5% and 94.4%), whereas MobileNetV2 and CranioNet presented worse values (91.1% and 89.8%). Our results prove the feasibility of applying deep learning architectures for real-time tool detection and phase estimation in craniosynostosis surgeries.

Is a greater degree of constraint really harmful? Clinical biomechanical comparative study between condylar constrained knee and rotating hinge prosthesis.

BACKGROUND: The real degree of constraint of rotating hinge knee and condylar constrained prostheses is a matter of discussion in revision knee arthroplasty. The objective of this study is to compare the tibial rotation between implants in the clinical settings. METHODS: An investigator blinded experimental study was designed including 20 patients: in 10 of them a rotating hinge knee prosthesis (Endomodel®, LINK) was implanted and in the remaining 10 a constrained condylar knee prosthesis (LCCK®, Zimmer) was used. A medial parapatellar approach was performed and implantation was performed according to conventional surgical technique. Tibial rotation was measured with two accelerometers in full extension and at 30°, 60° and 90° of flexion. Pre and postoperative Knee Injury and Osteoarthritis Outcome Score was recorded. FINDINGS: Both groups were homogenous in age (73.4 years in rotating hinge knee prosthesis vs 74 years in constrained condylar knee group), sex, laterality and preoperative Knee Injury and Osteoarthritis Outcome Score (p > 0.05). The postoperative Knee Injury and Osteoarthritis Outcome Score was significantly higher in the rotating hinge knee prosthesis group (80.98 vs 76.28). The degrees of tibial rotation measured by inertial sensors in the rotating hinge knee prosthesis group were also significantly higher than those measured in the constrained condylar knee group (5.66° vs 2.1°) with p = 0.001. INTERPRETATION: Rotating hinge knee prosthesis appears to represent a lower rotational constraint degree than constrained condylar knee systems in clinical practice and it may increase the clinical satisfaction. The clinical significance: Rotating hinge knee prosthesis appears to represent a lower constraint degree than constrained condylar knee systems in clinical practice.

Effectiveness of Automatic Planning of Fronto-orbital Advancement for the Surgical Correction of Metopic Craniosynostosis.

BACKGROUND: The surgical correction of metopic craniosynostosis usually relies on the subjective judgment of surgeons to determine the configuration of the cranial bone fragments and the degree of overcorrection. This study evaluates the effectiveness of a new approach for automatic planning of fronto-orbital advancement based on statistical shape models and including overcorrection. METHODS: This study presents a planning software to automatically estimate osteotomies in the fronto-orbital region and calculate the optimal configuration of the bone fragments required to achieve an optimal postoperative shape. The optimal cranial shape is obtained using a statistical head shape model built from 201 healthy subjects (age 23 ± 20 months; 89 girls). Automatic virtual plans were computed for nine patients (age 10.68 ± 1.73 months; four girls) with different degrees of overcorrection, and compared with manual plans designed by experienced surgeons. RESULTS: Postoperative cranial shapes generated by automatic interventional plans present accurate matching with normative morphology and enable to reduce the malformations in the fronto-orbital region by 82.01 ± 6.07%. The system took on average 19.22 seconds to provide the automatic plan, and allows for personalized levels of overcorrection. The automatic plans with an overcorrection of 7 mm in minimal frontal breadth provided the closest match (no significant difference) to the manual plans. CONCLUSIONS: The automatic software technology effectively achieves correct cranial morphometrics and volumetrics with respect to normative cranial shapes. The automatic approach has the potential to reduce the duration of preoperative planning, reduce inter-surgeon variability, and provide consistent surgical outcomes.

Three-dimensional photography for intraoperative morphometric analysis in metopic craniosynostosis surgery.

PURPOSE: Surgical correction of metopic craniosynostosis typically involves open cranial vault remodeling. Accurate translation of the virtual surgical plan into the operating room is challenging due to the lack of tools for intraoperative analysis of the surgical outcome. This study aimed to evaluate the feasibility of using a hand-held 3D photography device for intraoperative evaluation and guidance during cranial vault surgical reconstruction. METHODS: A hand-held structured light scanner was used for intraoperative 3D photography during five craniosynostosis surgeries, obtaining 3D models of skin and bone surfaces before and after the remodeling. The accuracy of this device for 3D modeling and morphology quantification was evaluated using preoperative computed tomography imaging as gold-standard. In addition, the time required for intraoperative 3D photograph acquisition was measured. RESULTS: The average error of intraoperative 3D photography was 0.30 mm. Moreover, the interfrontal angle and the transverse forehead width were accurately measured in the 3D photographs with an average error of 0.72 degrees and 0.62 mm. Surgeon's feedback indicates that this technology can be integrated into the surgical workflow without substantially increasing surgical time. CONCLUSION: Hand-held 3D photography is an accurate technique for objective quantification of intraoperative cranial vault morphology and guidance during metopic craniosynostosis surgical reconstruction. This noninvasive technique does not substantially increase surgical time and does not require exposure to ionizing radiation, presenting a valuable alternative to computed tomography imaging. The proposed methodology can be integrated into the surgical workflow to assist during cranial vault remodeling and ensure optimal surgical outcomes.

Computer-Assisted Dental Implant Placement Following Free Flap Reconstruction: Virtual Planning, CAD/CAM Templates, Dynamic Navigation and Augmented Reality.

Image-guided surgery, prosthetic-based virtual planning, 3D printing, and CAD/CAM technology are changing head and neck ablative and reconstructive surgical oncology. Due to quality-of-life improvement, dental implant rehabilitation could be considered in every patient treated with curative intent. Accurate implant placement is mandatory for prosthesis long-term stability and success in oncologic patients. We present a prospective study, with a novel workflow, comprising 11 patients reconstructed with free flaps and 56 osseointegrated implants placed in bone flaps or remnant jaws (iliac crest, fibula, radial forearm, anterolateral thigh). Starting from CT data and jaw plaster model scanning, virtual dental prosthesis was designed. Then prosthetically driven dental implacement was also virtually planned and transferred to the patient by means of intraoperative infrared optical navigation (first four patients), and a combination of conventional static teeth supported 3D-printed acrylic guide stent, intraoperative dynamic navigation, and augmented reality for final intraoperative verification (last 7 patients). Coronal, apical, and angular deviation between virtual surgical planning and final guided intraoperative position was measured on each implant. There is a clear learning curve for surgeons when applying guided methods. Initial only-navigated cases achieved low accuracy but were comparable to non-guided freehand positioning due to jig registration instability. Subsequent dynamic navigation cases combining highly stable acrylic static guides as reference and registration markers result in the highest accuracy with a 1-1.5-mm deviation at the insertion point. Smartphone-based augmented reality visualization is a valuable tool for intraoperative visualization and final verification, although it is still a difficult technique for guiding surgery. A fixed screw-retained ideal dental prosthesis was achieved in every case as virtually planned. Implant placement, the final step in free flap oncological reconstruction, could be accurately planned and placed with image-guided surgery, 3D printing, and CAD/CAM technology. The learning curve could be overcome with preclinical laboratory training, but virtually designed and 3D-printed tracer registration stability is crucial for accurate and predictable results. Applying these concepts to our difficult oncologic patient subgroup with deep anatomic alterations ended in comparable results as those reported in non-oncologic patients.

Surgical Navigation, Augmented Reality, and 3D Printing for Hard Palate Adenoid Cystic Carcinoma En-Bloc Resection: Case Report and Literature Review.

Adenoid Cystic Carcinoma is a rare and aggressive tumor representing less than 1% of head and neck cancers. This malignancy often arises from the minor salivary glands, being the palate its most common location. Surgical en-bloc resection with clear margins is the primary treatment. However, this location presents a limited line of sight and a high risk of injuries, making the surgical procedure challenging. In this context, technologies such as intraoperative navigation can become an effective tool, reducing morbidity and improving the safety and accuracy of the procedure. Although their use is extended in fields such as neurosurgery, their application in maxillofacial surgery has not been widely evidenced. One reason is the need to rigidly fixate a navigation reference to the patient, which often entails an invasive setup. In this work, we studied three alternative and less invasive setups using optical tracking, 3D printing and augmented reality. We evaluated their precision in a patient-specific phantom, obtaining errors below 1 mm. The optimum setup was finally applied in a clinical case, where the navigation software was used to guide the tumor resection. Points were collected along the surgical margins after resection and compared with the real ones identified in the postoperative CT. Distances of less than 2 mm were obtained in 90% of the samples. Moreover, the navigation provided confidence to the surgeons, who could then undertake a less invasive and more conservative approach. The postoperative CT scans showed adequate resection margins and confirmed that the patient is free of disease after two years of follow-up.

Combining Augmented Reality and 3D Printing to Display Patient Models on a Smartphone.

Augmented reality (AR) has great potential in education, training, and surgical guidance in the medical field. Its combination with three-dimensional (3D) printing (3DP) opens new possibilities in clinical applications. Although these technologies have grown exponentially in recent years, their adoption by physicians is still limited, since they require extensive knowledge of engineering and software development. Therefore, the purpose of this protocol is to describe a step-by-step methodology enabling inexperienced users to create a smartphone app, which combines AR and 3DP for the visualization of anatomical 3D models of patients with a 3D-printed reference marker. The protocol describes how to create 3D virtual models of a patient's anatomy derived from 3D medical images. It then explains how to perform positioning of the 3D models with respect to marker references. Also provided are instructions for how to 3D print the required tools and models. Finally, steps to deploy the app are provided. The protocol is based on free and multi-platform software and can be applied to any medical imaging modality or patient. An alternative approach is described to provide automatic registration between a 3D-printed model created from a patient's anatomy and the projected holograms. As an example, a clinical case of a patient suffering from distal leg sarcoma is provided to illustrate the methodology. It is expected that this protocol will accelerate the adoption of AR and 3DP technologies by medical professionals.

Craniosynostosis surgery: workflow based on virtual surgical planning, intraoperative navigation and 3D printed patient-specific guides and templates.

Craniosynostosis must often be corrected using surgery, by which the affected bone tissue is remodeled. Nowadays, surgical reconstruction relies mostly on the subjective judgement of the surgeon to best restore normal skull shape, since remodeled bone is manually placed and fixed. Slight variations can compromise the cosmetic outcome. The objective of this study was to describe and evaluate a novel workflow for patient-specific correction of craniosynostosis based on intraoperative navigation and 3D printing. The workflow was followed in five patients with craniosynostosis. Virtual surgical planning was performed, and patient-specific cutting guides and templates were designed and manufactured. These guides and templates were used to control osteotomies and bone remodeling. An intraoperative navigation system based on optical tracking made it possible to follow preoperative virtual planning in the operating room through real-time positioning and 3D visualization. Navigation accuracy was estimated using intraoperative surface scanning as the gold-standard. An average error of 0.62 mm and 0.64 mm was obtained in the remodeled frontal region and supraorbital bar, respectively. Intraoperative navigation is an accurate and reproducible technique for correction of craniosynostosis that enables optimal translation of the preoperative plan to the operating room.

Augmented reality in computer-assisted interventions based on patient-specific 3D printed reference.

Augmented reality (AR) can be an interesting technology for clinical scenarios as an alternative to conventional surgical navigation. However, the registration between augmented data and real-world spaces is a limiting factor. In this study, the authors propose a method based on desktop three-dimensional (3D) printing to create patient-specific tools containing a visual pattern that enables automatic registration. This specific tool fits on the patient only in the location it was designed for, avoiding placement errors. This solution has been developed as a software application running on Microsoft HoloLens. The workflow was validated on a 3D printed phantom replicating the anatomy of a patient presenting an extraosseous Ewing's sarcoma, and then tested during the actual surgical intervention. The application allowed physicians to visualise the skin, bone and tumour location overlaid on the phantom and patient. This workflow could be extended to many clinical applications in the surgical field and also for training and simulation, in cases where hard body structures are involved. Although the authors have tested their workflow on AR head mounted display, they believe that a similar approach can be applied to other devices such as tablets or smartphones.