NextLens-The Next Generation of Surgical Navigation: Proof of Concept of an Augmented Reality System for Surgical Navigation.

Objective The aim of this work was the development of an augmented reality system including the functionality of conventional surgical navigation systems. Methods An application software for the Augmented Reality System HoloLens 2 from Microsoft was developed. It detects the position of the patient as well as position of surgical instruments in real time and displays it within the two-dimensional (2D) magnetic resonance imaging or computed tomography (CT) images. The surgical pointer instrument, including a pattern that is recognized by the HoloLens 2 sensors, was created with three-dimensional (3D) printing. The technical concept was demonstrated at a cadaver skull to identify anatomical landmarks. Results With the help of the HoloLens 2 and its sensors, the real-time position of the surgical pointer instrument could be shown. The position of the 3D-printed pointer with colored pattern could be recognized within 2D-CT images when stationary and in motion at a cadaver skull. Feasibility could be demonstrated for the clinical application of transsphenoidal pituitary surgery. Conclusion The HoloLens 2 has a high potential for use as a surgical navigation system. With subsequent studies, a further accuracy evaluation will be performed receiving valid data for comparison with conventional surgical navigation systems. In addition to transsphenoidal pituitary surgery, it could be also applied for other surgical disciplines.

Analysis of the Technical Accuracy of a Patient-Specific Stereotaxy Platform for Brain Biopsy.

The use of stereotactic frames is a common practice in neurosurgical interventions such as brain biopsy and deep brain stimulation. However, conventional stereotactic frames have been shown to require modification and adaptation regarding patient and surgeon comfort as well as the increasing demand for individualized medical treatment. To meet these requirements for carrying out state-of-the-art neurosurgery, a 3D print-based, patient-specific stereotactic system was developed and examined for technical accuracy. Sixteen patient-specific frames, each with two target points, were additively manufactured from PA12 using the Multi Jet Fusion process. The 32 target points aim to maximize the variability of biopsy targets and depths for tissue sample retrieval in the brain. Following manufacturing, the frames were measured three-dimensionally using an optical scanner. The frames underwent an autoclave sterilization process prior to rescanning. The scan-generated models were compared with the planned CAD models and the deviation of the planned target points in the XY-plane, Z-direction and in the resulting direction were determined. Significantly lower (p < 0.01) deviations were observed when comparing CAD vs. print and print vs. sterile in the Z-direction (0.17 mm and 0.06 mm, respectively) than in the XY-plane (0.46 mm and 0.16 mm, respectively). The resulting target point deviation (0.51 mm) and the XY-plane (0.46 mm) are significantly higher (p < 0.01) in the CAD vs. print comparison than in the print vs. sterile comparison (0.18 mm and 0.16 mm, respectively). On average, the results from the 32 target positions examined exceeded the clinically required accuracy for a brain biopsy (2 mm) by more than four times. The patient-specific stereotaxic frames meet the requirements of modern neurosurgical navigation and make no compromises when it comes to accuracy. In addition, the material is suitable for autoclave sterilization due to resistance to distortion.

IMAGINER: improving accuracy with a mixed reality navigation system during placement of external ventricular drains. A feasibility study.

OBJECTIVE: The placement of a ventricular catheter, that is, an external ventricular drain (EVD), is a common and essential neurosurgical procedure. In addition, it is one of the first procedures performed by inexperienced neurosurgeons. With or without surgical experience, the placement of an EVD according to anatomical landmarks only can be difficult, with the potential risk for inaccurate catheter placement. Repeated corrections can lead to avoidable complications. The use of mixed reality could be a helpful guide and improve the accuracy of drain placement, especially in patients with acute pathology leading to the displacement of anatomical structures. Using a human cadaveric model in this feasibility study, the authors aimed to evaluate the accuracy of EVD placement by comparing two techniques: mixed reality and freehand placement. METHODS: Twenty medical students performed the EVD placement procedure with a Cushing's ventricular cannula on the right and left sides of the ventricular system. The cannula was placed according to landmarks on one side and with the assistance of mixed reality (Microsoft HoloLens 2) on the other side. With mixed reality, a planned trajectory was displayed in the field of view that guides the placement of the cannula. Subsequently, the actual position of the cannula was assessed with the help of a CT scan with a 1-mm slice thickness. The bony structure as well as the left and right cannula positions were registered to the CT scan with the planned target point before the placement procedure. CloudCompare software was applied for registration and evaluation of accuracy. RESULTS: EVD placement using mixed reality was easily performed by all medical students. The predefined target point (inside the lateral ventricle) was reached with both techniques. However, the scattering radius of the target point reached through the use of mixed reality (12 mm) was reduced by more than 54% compared with the puncture without mixed reality (26 mm), which represents a doubling of the puncture accuracy. CONCLUSIONS: This feasibility study specifically showed that the integration and use of mixed reality helps to achieve more than double the accuracy in the placement of ventricular catheters. Because of the easy availability of these new tools and their intuitive handling, we see great potential for mixed reality to improve accuracy.

Mixed reality for spine surgery: a step into the future with a human cadaveric accuracy study.

OBJECTIVE: Current application of mixed reality as a navigation aid in the field of spinal navigation points to the potential of this technology in spine surgery. Crucial factors for acceptance include intuitive workflow, system stability, reliability, and accuracy of the method. The authors therefore aimed to investigate the accuracy of the system in visualization of anatomical structures using mixed reality in the example of pedicles of the thoracic spine in a human cadaveric study. Potential difficulties and limitations are discussed. METHODS: CT scans of a human cadaveric spinal column specimen were performed. After segmentation and import into the advanced HoloLens 2 software, the vertebrae were exposed. The vertebral arches were preserved on one side for a landmark-based surface registration, whereas pedicles were exposed on the other side in order to measure and evaluate deviation of the overlay holographs with regard to the exact anatomical structure. Accuracy was measured and statistically evaluated. RESULTS: In this work it was demonstrated that the overlay of the virtual 3D model pedicles with the real anatomical structures with anatomical landmark registration was within an acceptable surgical accuracy with the mean value of 2.1 mm (maximum 3.8 mm, minimum 1.2 mm). The highest accuracy was registered at the medial and lateral pedicle wall, and the measurement results were best in the region of the middle thoracic spine. CONCLUSIONS: The accuracy analysis for mixed reality (i.e., between the virtual and real anatomical situation of the thoracic spine) showed a very good agreement when focus was on the pedicles. This work is thus a rare proof of the precision of segmentation to the potential surgical area. The results encourage researchers to open up mixed reality technology in its development and application for spinal navigation.

Students' perspectives regarding needs for and opportunities with mixed-reality education in neurosurgery at German medical schools.

OBJECTIVE: Despite mixed reality being an emerging tool for tailored neurosurgical treatment and safety enhancement, the use of mixed reality in the education of German medical students is not established in the field of neurosurgery. The present study aimed to investigate medical students' perspectives on the use of mixed reality in neurosurgical medical education. METHODS: Between July 3, 2023, and August 31, 2023, an online survey was completed by German medical students through their affiliated student associations and educational institutions. The survey included 16 items related to mixed reality in neurosurgery, with participants providing ratings on a 4-point Likert scale to indicate their level of agreement with these statements. RESULTS: A total of 150 students from 27 medical schools in Germany took part in the survey. A significant majority comprising 131 (87.3%) students expressed strong to intense interest in mixed-reality courses in neurosurgery, and 108 (72%) reported an interest in incorporating mixed reality into their curriculum. Furthermore, 94.7% agreed that mixed reality may enhance their understanding of operative neuroanatomy and 72.7% agreed with the idea that teaching via mixed-reality methods may increase the probability of the use of mixed reality in their future career. The majority (116/150 [77.3%]) reported that the preferred optimum timepoint for teaching with mixed reality might be within the first 3 years of medical school. In particular, more students in the first 2 years preferred to start mixed-reality courses in the first 2 years of medical school compared to students in their 3rd to 6th years of medical school (71.9% vs 41.5%, p = 0.003). Residents and attending specialists were believed to be appropriate teachers by 118 students (78.7%). CONCLUSIONS: German medical students exhibited significant interest and willingness to engage in mixed reality in neurosurgery. Evidently, there is a high demand for medical schools to provide mixed-reality courses. Students seem to prefer the courses as early as possible in their medical school education in order to transfer preclinical neuroanatomical knowledge into operative neurosurgical anatomy by using this promising technique.