Visual extended reality tools in image-guided surgery in urology: a systematic review.

PURPOSE: The aim of this systematic review is to assess the clinical implications of employing various Extended Reality (XR) tools for image guidance in urological surgery. METHODS: In June 2023, a systematic electronic literature search was conducted using the Medline database (via PubMed), Embase (via Ovid), Scopus, and Web of Science. The search strategy was designed based on the PICO (Patients, Intervention, Comparison, Outcome) criteria. Study protocol was registered on PROSPERO (registry number CRD42023449025). We incorporated retrospective and prospective comparative studies, along with single-arm studies, which provided information on the use of XR, Mixed Reality (MR), Augmented Reality (AR), and Virtual Reality (VR) in urological surgical procedures. Studies that were not written in English, non-original investigations, and those involving experimental research on animals or cadavers were excluded from our analysis. The quality assessment of comparative and cohort studies was conducted utilizing the Newcastle-Ottawa scale, whilst for randomized controlled trials (RCTs), the Jadad scale was adopted. The level of evidence for each study was determined based on the guidelines provided by the Oxford Centre for Evidence-Based Medicine. RESULTS: The initial electronic search yielded 1,803 papers after removing duplicates. Among these, 58 publications underwent a comprehensive review, leading to the inclusion of 40 studies that met the specified criteria for analysis. 11, 20 and 9 studies tested XR on prostate cancer, kidney cancer and miscellaneous, including bladder cancer and lithiasis surgeries, respectively. Focusing on the different technologies 20, 15 and 5 explored the potential of VR, AR and MR. The majority of the included studies (i.e., 22) were prospective non-randomized, whilst 7 and 11 were RCT and retrospective studies respectively. The included studies that revealed how these new tools can be useful both in preoperative and intraoperative setting for a tailored surgical approach. CONCLUSIONS: AR, VR and MR techniques have emerged as highly effective new tools for image-guided surgery, especially for urologic oncology. Nevertheless, the complete clinical advantages of these innovations are still in the process of evaluation.

Remote proctoring during structural heart procedures: Toward a widespread diffusion of knowledge using mixed reality.

BACKGROUND: Despite its wide diffusion in surgical procedures, very few experiences are reported so far about the possible applications of remote proctoring (RP) in structural heart interventions. AIMS: Our aim was to demonstrate the feasibility, safety, and efficacy of RP during transcatheter edge-to-edge repair using a mixed reality-based head-mounted display (HMD). METHODS: Two users (a doctor and a proctor), wearing HMDs, were connected through a 5G network, allowing them to share audio and video signals. During the procedure, the proctor was located in a contiguous room, without any direct connection with the operator. The primary endpoint was noninferiority of HMD-mediated interaction if compared with direct in-person interaction. It was assessed using an operator-proctor interaction test based on six questions asked by the doctor to the proctor on six key procedural steps. RESULTS: Between September 2021 and April 2022, nine patients were enrolled in the study (15 clips delivered). The primary endpoint was reached in 9/15 clips implanted (60%). The first three failures were due to a chat software problem, and the others were linked with a 5G network malfunction. However, the HMD and its mixed reality tools were well tolerated by the operators, and no interference with the procedure was registered in any of the cases. CONCLUSIONS: In our experience, RP during structural heart interventions is feasible and efficacious. Wearing the HMD is comfortable and does not affect safety and effectiveness of interventional procedures. However, especially if considering a wide geographic use of this tool, a stable internet connection is imperative.

Digital nature: Unveiling the impact and safety of FlowVR group intervention for depression in a feasibility trial.

OBJECTIVE: This study addresses the limitations of existing interventions for depression, such as a deficit-oriented focus, overlooking the utilization of positive elements such as nature, and neglecting the incorporation of group effects. The present feasibility study examines FlowVR, a resource-oriented, nature-inspired virtual reality (VR)-based group therapy. Previously tested individually in a pilot study for non-clinical participants, FlowVR has demonstrated positive effects on depressive symptoms. This study assesses the impact and safety of FlowVR in a group setting within a clinical sample using a one-armed study design. METHOD: Forty-two inpatients and day patients with depression were recruited. Before and after the FlowVR intervention period of 4 weeks (two sessions per week), depressive symptoms were assessed (Beck Depression Inventory-II; BDI). Symptomatology (i.e., depressive symptoms), depression-associated variables (i.e., self-efficacy), intervention-specific variables (feeling of flow), and VR-specific variables (simulator sickness) were assessed before and after each session. RESULTS: Linear mixed effect models showed that symptomatology (depression, negative affect, current anxiety), depression-associated constructs (self-efficacy, motivation), and intervention-specific variables (flow) improved over the course of the sessions. No variable deteriorated more in one session compared to any other session. The lasso regression identified five potential predictors for the change in depression (BDI-II), yet these could not be validated in a subsequent linear regression analysis. CONCLUSION: To conclude, FlowVR had the hypothesized positive impact over the course of the sessions, showing, for example, improvements in symptomatology. The sessions have demonstrated safety with no notable deteriorations. Therefore, FlowVR is deemed safe for clinical patients and group settings. However, further research is needed to explore predictors for the change in depression.

Apple Intelligence in neurosurgery.

With the current artificial intelligence (AI) boom, new innovative and accessible applications requiring minimal computer science expertise have been developed for discipline specific and mainstream purposes. Apple Intelligence, a new AI model developed by Apple, aims to enhance user experiences with new functionalities across many of its product offerings. Although designed for the everyday user, many of these advances have potential applications in neurosurgery. These include functionalities for writing, image generation, and upgraded integrations to the voice command assistant Siri. Future integrations may also include other Apple products such as the vision pro for preoperative and intraoperative applications. Considering the popularity of Apple products, particularly the iPhone, it is important to appraise this new technology and how it can be leveraged to enhance patient care, improve neurosurgical education, and facilitate more efficiency for the neurosurgeon.

IMAGINER: improving accuracy with a mixed reality navigation system during placement of external ventricular drains. A feasibility study.

OBJECTIVE: The placement of a ventricular catheter, that is, an external ventricular drain (EVD), is a common and essential neurosurgical procedure. In addition, it is one of the first procedures performed by inexperienced neurosurgeons. With or without surgical experience, the placement of an EVD according to anatomical landmarks only can be difficult, with the potential risk for inaccurate catheter placement. Repeated corrections can lead to avoidable complications. The use of mixed reality could be a helpful guide and improve the accuracy of drain placement, especially in patients with acute pathology leading to the displacement of anatomical structures. Using a human cadaveric model in this feasibility study, the authors aimed to evaluate the accuracy of EVD placement by comparing two techniques: mixed reality and freehand placement. METHODS: Twenty medical students performed the EVD placement procedure with a Cushing's ventricular cannula on the right and left sides of the ventricular system. The cannula was placed according to landmarks on one side and with the assistance of mixed reality (Microsoft HoloLens 2) on the other side. With mixed reality, a planned trajectory was displayed in the field of view that guides the placement of the cannula. Subsequently, the actual position of the cannula was assessed with the help of a CT scan with a 1-mm slice thickness. The bony structure as well as the left and right cannula positions were registered to the CT scan with the planned target point before the placement procedure. CloudCompare software was applied for registration and evaluation of accuracy. RESULTS: EVD placement using mixed reality was easily performed by all medical students. The predefined target point (inside the lateral ventricle) was reached with both techniques. However, the scattering radius of the target point reached through the use of mixed reality (12 mm) was reduced by more than 54% compared with the puncture without mixed reality (26 mm), which represents a doubling of the puncture accuracy. CONCLUSIONS: This feasibility study specifically showed that the integration and use of mixed reality helps to achieve more than double the accuracy in the placement of ventricular catheters. Because of the easy availability of these new tools and their intuitive handling, we see great potential for mixed reality to improve accuracy.

Improving mixed-reality neuronavigation with blue-green light: a comparative multimodal laboratory study.

OBJECTIVE: This study aimed to rigorously assess the accuracy of mixed-reality neuronavigation (MRN) in comparison with magnetic neuronavigation (MN) through a comprehensive phantom-based experiment. It introduces a novel dimension by examining the influence of blue-green light (BGL) on MRN accuracy, a previously unexplored avenue in this domain. METHODS: Twenty-nine phantoms, each meticulously marked with 5-6 fiducials, underwent CT scans as part of the navigation protocol. A 3D model was then superimposed onto a 3D-printed plaster skull using a semiautomatic registration process. The study meticulously evaluated the accuracy of both navigation techniques by pinpointing specific markers on the plaster surface. Precise measurements were then taken using digital calipers, with navigation conducted under three distinct lighting conditions: indirect white light (referred to as no light [NL]), direct white light (WL), and BGL. The research enlisted two operators with distinct levels of experience, one senior and one junior, to ensure a comprehensive analysis. The study was structured into two distinct experiments (experiment 1 [MN] and experiment 2 [MRN]) conducted by the two operators. Data analysis focused on calculating average and median values within subgroups, considering variables such as the type of lighting, precision, and recording time. RESULTS: In experiment 1, no statistically significant differences emerged between the two operators. However, in experiment 2, notable disparities became apparent, with the senior operator recording longer times but achieving higher precision. Most significantly, BGL consistently demonstrated a capacity to enhance accuracy in MRN across both experiments. CONCLUSIONS: This study demonstrated the substantial positive influence of BGL on MRN accuracy, providing profound implications for the design and implementation of mixed-reality systems. It also emphasized that integrating BGL into mixed-reality environments could profoundly improve user experience and performance. Further research is essential to validate these findings in real-world settings and explore the broader potential of BGL in a variety of mixed-reality applications.

Students' perspectives regarding needs for and opportunities with mixed-reality education in neurosurgery at German medical schools.

OBJECTIVE: Despite mixed reality being an emerging tool for tailored neurosurgical treatment and safety enhancement, the use of mixed reality in the education of German medical students is not established in the field of neurosurgery. The present study aimed to investigate medical students' perspectives on the use of mixed reality in neurosurgical medical education. METHODS: Between July 3, 2023, and August 31, 2023, an online survey was completed by German medical students through their affiliated student associations and educational institutions. The survey included 16 items related to mixed reality in neurosurgery, with participants providing ratings on a 4-point Likert scale to indicate their level of agreement with these statements. RESULTS: A total of 150 students from 27 medical schools in Germany took part in the survey. A significant majority comprising 131 (87.3%) students expressed strong to intense interest in mixed-reality courses in neurosurgery, and 108 (72%) reported an interest in incorporating mixed reality into their curriculum. Furthermore, 94.7% agreed that mixed reality may enhance their understanding of operative neuroanatomy and 72.7% agreed with the idea that teaching via mixed-reality methods may increase the probability of the use of mixed reality in their future career. The majority (116/150 [77.3%]) reported that the preferred optimum timepoint for teaching with mixed reality might be within the first 3 years of medical school. In particular, more students in the first 2 years preferred to start mixed-reality courses in the first 2 years of medical school compared to students in their 3rd to 6th years of medical school (71.9% vs 41.5%, p = 0.003). Residents and attending specialists were believed to be appropriate teachers by 118 students (78.7%). CONCLUSIONS: German medical students exhibited significant interest and willingness to engage in mixed reality in neurosurgery. Evidently, there is a high demand for medical schools to provide mixed-reality courses. Students seem to prefer the courses as early as possible in their medical school education in order to transfer preclinical neuroanatomical knowledge into operative neurosurgical anatomy by using this promising technique.

Assessing views and attitudes toward the use of extended reality and its implications in neurosurgical education: a survey of neurosurgical trainees.

OBJECTIVE: Extended reality (XR) systems, including augmented reality (AR), virtual reality (VR), and mixed reality, have rapidly emerged as new technologies capable of changing the way neurosurgeons prepare for cases. Thus, the authors sought to evaluate the perspectives of neurosurgical trainees on the integration of these technologies into neurosurgical education. METHODS: A 20-question cross-sectional survey was administered to neurosurgical residents and fellows to evaluate perceptions of the use of XR in neurosurgical training. Respondents evaluated each statement using a modified Likert scale (1-5). RESULTS: One hundred sixteen responses were recorded, with 59.5% of participants completing more than 90% of the questions. Approximately 59% of participants reported having institutional access to XR technologies. The majority of XR users (72%) believed it was effective for simulating surgical situations, compared with only 41% for those who did not have access to XR. Most respondents (61%) agreed that XR could become a standard in neurosurgical education and a cost-effective training tool (60%). Creating patient-specific anatomical XR models was considered relatively easy by 56% of respondents. Those with XR access reported finding it easier to create intraoperative models (58%) than those without access. A significant percentage (79%) agreed on the need for technical skill training outside the operating room (OR), especially among those without XR access (82%). There was general agreement (60%) regarding the specific need for XR. XR was perceived as effectively simulating stress in the OR. Regarding clinical outcomes, 61% believed XR improved efficiency and safety and 48% agreed it enhanced resection margins. Major barriers to XR integration included lack of ample training hours and/or time to use XR amid daily clinical obligations (63%). CONCLUSIONS: The data presented in this study indicate that there is broad agreement among neurosurgical trainees that XR holds potential as a training modality in neurosurgical education. Moreover, trainees who have access to XR technologies tend to hold more positive perceptions regarding the benefits of XR in their training. This finding suggests that the availability of XR resources can positively influence trainees' attitudes and beliefs regarding the utility of these technologies in their education and training.

A patient-specific, interactive, multiuser, online mixed-reality neurosurgical training and planning system.

OBJECTIVE: Mixed-reality simulation is an emerging tool for creating anatomical models for preoperative planning. Its use in neurosurgical training (NT) has been limited because of the difficulty in real-time interactive teaching. This study describes the development of a patient-specific, interactive mixed-reality NT system. The authors took cases of intracranial tumor resection or neurovascular compression (NVC) as examples to verify the technical feasibility and efficacy of the mixed-reality NT system for residents' training and preoperative planning. METHODS: This study prospectively enrolled 40 patients who suffered from trigeminal neuralgia, hemifacial spasms, or intracranial tumors. The authors used a series of software programs to process the multimodal imaging data, followed by uploading the holographic models online. They used a HoloLens or a standard iOS device to download and display the holographic models for training. Ten neurosurgical residents with different levels of surgical experience were trained with this mixed-reality NT system. Change in surgical strategy was recorded, and a questionnaire survey was conducted to evaluate the efficacy of the mixed-reality NT system. RESULTS: The system allows the trainer and trainee to view the mixed-reality model with either a HoloLens or an iPad/iPhone simultaneously online at different locations. Interactive manipulation and instant updates were able to be achieved during training. A clinical efficacy validation test was conducted. The surgeons changed their exploration strategy in 48.3% of the NVC cases. For residents with limited experience in surgery, the exploration strategy for 75.0% of all patients with NVC was changed after the residents were trained with the mixed-reality NT system. Of the 60 responses for intracranial tumors, the trainee changed the surgical posture in 19 (31.7%) cases. The change of the location (p = 0.0338) and size (p = 0.0056) of craniotomy are significantly related to the experience of the neurosurgeons. CONCLUSIONS: The mixed-reality NT system is available for local or real-time remote neurosurgical resident training. It may effectively help neurosurgeons in patient-specific training and planning of surgery for cases of NVC and intracranial tumor. The authors expect the system to have a broader application in neurosurgery in the near future.

Intraoperative mixed-reality spinal neuronavigation system: a novel navigation technique for spinal intradural pathologies.

OBJECTIVE: The objective of this study was to assess the intraoperative accuracy and feasibility of 3D-printed marker-based mixed-reality neurosurgical navigation for spinal intradural pathologies. METHODS: The authors produced 3D segmentations of spinal intradural tumors with neighboring structures by using combined CT and MRI, and preoperative registration of pathology and markers was successfully performed. A patient-specific, surgeon-facilitated application for mobile devices was built, and a mixed-reality light detection and ranging (LIDAR) camera on a mobile device was employed for cost-effective, high-accuracy spinal neuronavigation. RESULTS: Mobile device LIDAR cameras can successfully overlay images of virtual tumor segmentations according to the position of a 3D-printed marker. The surgeon can visualize and manipulate 3D segmentations of the pathology intraoperatively in 3D. CONCLUSIONS: A 3D-printed marker-based mixed-reality spinal neuronavigation technique was performed in spinal intradural pathology procedures and has potential to be clinically feasible and easy to use for surgeons, as well as being time saving, cost-effective, and highly precise for spinal surgical procedures.

The role of extended reality in eloquent area lesions: a systematic review.

OBJECTIVE: The surgical approach to lesions near eloquent areas continues to represent a challenge for neurosurgeons, despite all of the sophisticated tools currently used. The goal of surgery in eloquent areas is to maintain a good oncofunctional balance, that is, to preserve neurological function and ensure maximum tumor resection. Among all the available tools, extended reality (used to describe both virtual reality [VR] and mixed reality) is rapidly gaining a pivotal role in such delicate lesions, especially in preoperative planning, and recently, even during the surgical procedure. VR creates a completely new world in which only digital components are present. Augmented reality (AR), using software and hardware to introduce digital elements into the real-world environment, enhances the human experience. In addition, mixed reality, a more recent technique, combines VR and AR by projecting virtual objects into the real world, allowing the user to interact with them. METHODS: A systematic literature review of the last 23.5 years was conducted (January 2000-June 2023) to investigate and discuss all progress related to the emerging role and use of these new technologies (VR, AR, and mixed reality), particularly in eloquent area lesions as a pre- and/or intraoperative tool. RESULTS: Five hundred eighty-four published studies were identified. After removing duplicates and excluding articles that did not meet the inclusion criteria, 21 papers were included in the systematic review. The use of AR or VR was fully analyzed, considering their roles both intraoperatively and for surgical planning. CONCLUSIONS: The increasing use of such innovative technologies has completely changed the way to approach a lesion, using 3D visualization to foster a better understanding of its anatomical and vascular characteristics.

Innovations in craniovertebral junction training: harnessing the power of mixed reality and head-mounted displays.

OBJECTIVE: The objective of this study was to analyze the potential and convenience of using mixed reality as a teaching tool for craniovertebral junction (CVJ) anomaly pathoanatomy. METHODS: CT and CT angiography images of 2 patients with CVJ anomalies were used to construct mixed reality models in the HoloMedicine application on the HoloLens 2 headset, resulting in four viewing stations. Twenty-two participants were randomly allocated into two groups, with each participant rotating through all stations for 90 seconds, each in a different order based on their group. At every station, objective questions evaluating the understanding of CVJ pathoanatomy were answered. At the end, subjective opinion on the user experience of mixed reality was provided using a 5-point Likert scale. The objective performance of the two viewing modes was compared, and a correlation between performance and participant experience was sought. Subjective feedback was compiled and correlated with experience. RESULTS: In both groups, there was a significant improvement in median (interquartile range [IQR]) objective performance with mixed reality compared with DICOM: 1) group A: case 1, median 6 (IQR 6-7) versus 5 (IQR 3-6), p = 0.009; case 2, median 6 (IQR 6-7) versus 5 (IQR 3-6), p = 0.02; 2) group B: case 1, median 6 (IQR 5-7) versus 4 (IQR 2-5), p = 0.04; case 2, median 6 (IQR 6-7) versus 5 (IQR 3-7), p = 0.03. There was significantly higher improvement in less experienced participants in both groups for both cases: 1) group A: case 1, r = -0.8665, p = 0.0005; case 2, r = -0.8002, p = 0.03; 2) group B: case 1, r = -0.6977, p = 0.01; case 2, r = -0.7417, p = 0.009. Subjectively, mixed reality was easy to use, with less disorientation due to the visible background, and it was believed to be a useful teaching tool. CONCLUSIONS: Mixed reality is an effective teaching tool for CVJ pathoanatomy, particularly for young neurosurgeons and trainees. The versatility of mixed reality and the intuitiveness of the user experience offer many potential applications, including training, intraoperative guidance, patient counseling, and individualized medicine; consequently, mixed reality has the potential to transform neurosurgery.

Impact of augmented reality fiber tractography on the extent of resection and functional outcome of primary motor area tumors.

OBJECTIVE: This study aimed to evaluate the impact of augmented reality intraoperative fiber tractography (AR-iFT) on extent of resection (EOR), motor functional outcome, and survival of patients with primary motor area (M1) intra-axial malignant tumors. METHODS: Data obtained from patients who underwent AR-iFT for M1 primary tumors were retrospectively analyzed and compared with those from a control group who underwent unaugmented reality intraoperative fiber tractography (unAR-iFT). A full asleep procedure with electrical stimulation mapping and fluorescein guidance was performed in both groups. The Neurological Assessment in Neuro-Oncology (NANO), Medical Research Council (MRC), and House-Brackmann grading systems were used for neurological, motor, and facial nerve assessment, respectively. Three-month postoperative NANO and MRC scores were used as outcome measures of the safety of the technique, whereas EOR and survival curves were related to its cytoreductive efficacy. In this study, p < 0.05 indicated statistical significance. RESULTS: This study included 34 and 31 patients in the AR-iFT and unAR-iFT groups, respectively. The intraoperative seizure rate, 3-month postoperative NANO score, and 1-week and 1-month MRC scores were significantly (p < 0.05) different and in favor of the AR-iFT group. However, no difference was observed in the rate of complications. Glioma had incidence rates of 58.9% and 51.7% in the study and control groups, respectively, with no statistical difference. Metastasis had a slightly higher incidence rate in the control group, without statistical significance, and the gross-total resection and near-total resection rates and progression-free survival (PFS) rate were higher in the study group. Overall survival was not affected by the technique. CONCLUSIONS: AR-iFT proved to be feasible, effective, and safe during surgery for M1 tumors and positively affected the EOR, intraoperative seizure rate, motor outcome, and PFS. Integration with electrical stimulation mapping is critical to achieve constant anatomo-functional intraoperative feedback. The accuracy of AR-iFT is intrinsically limited by diffusion tensor-based techniques, parallax error, and fiber tract crowding. Further studies are warranted to definitively validate the benefits of augmented reality navigation in this surgical scenario.

Accuracy of routine external ventricular drain placement following a mixed reality-guided twist-drill craniostomy.

OBJECTIVE: The traditional freehand placement of an external ventricular drain (EVD) relies on empirical craniometric landmarks to guide the craniostomy and subsequent passage of the EVD catheter. The diameter and trajectory of the craniostomy physically limit the possible trajectories that can be achieved during the passage of the catheter. In this study, the authors implemented a mixed reality-guided craniostomy procedure to evaluate the benefit of an optimally drilled craniostomy to the accurate placement of the catheter. METHODS: Optical marker-based tracking using an OptiTrack system was used to register the brain ventricular hologram and drilling guidance for craniostomy using a HoloLens 2 mixed reality headset. A patient-specific 3D-printed skull phantom embedded with intracranial camera sensors was developed to automatically calculate the EVD accuracy for evaluation. User trials consisted of one blind and one mixed reality-assisted craniostomy followed by a routine, unguided EVD catheter placement for each of two different drill bit sizes. RESULTS: A total of 49 participants were included in the study (mean age 23.4 years, 59.2% female). The mean distance from the catheter target improved from 18.6 ± 12.5 mm to 12.7 ± 11.3 mm (p = 0.0008) using mixed reality guidance for trials with a large drill bit and from 19.3 ± 12.7 mm to 10.1 ± 8.4 mm with a small drill bit (p < 0.0001). Accuracy using mixed reality was improved using a smaller diameter drill bit compared with a larger bit (p = 0.039). Overall, the majority of the participants were positive about the helpfulness of mixed reality guidance and the overall mixed reality experience. CONCLUSIONS: Appropriate indications and use cases for the application of mixed reality guidance to neurosurgical procedures remain an area of active inquiry. While prior studies have demonstrated the benefit of mixed reality-guided catheter placement using predrilled craniostomies, the authors demonstrate that real-time quantitative and visual feedback of a mixed reality-guided craniostomy procedure can independently improve procedural accuracy and represents an important tool for trainee education and eventual clinical implementation.

Combined use of 3D printing and mixed reality technology for neurosurgical training: getting ready for brain surgery.

OBJECTIVE: Learning surgical skills is an essential part of neurosurgical training. Ideally, these skills are acquired to a sufficient extent in an ex vivo setting. The authors previously described an in vitro brain tumor model, consisting of a cadaveric animal brain injected with fluorescent agar-agar, for acquiring a wide range of basic neuro-oncological skills. This model focused on haptic skills such as safe tissue ablation technique and the training of fluorescence-based resection. As important didactical technologies such as mixed reality and 3D printing become more readily available, the authors developed a readily available training model that integrates the haptic aspects into a mixed reality setup. METHODS: The anatomical structures of a brain tumor patient were segmented from medical imaging data to create a digital twin of the case. Bony structures were 3D printed and combined with the in vitro brain tumor model. The segmented structures were visualized in mixed reality headsets, and the congruence of the printed and the virtual objects allowed them to be spatially superimposed. In this way, users of the system were able to train on the entire treatment process from surgery planning to instrument preparation and execution of the surgery. RESULTS: Mixed reality visualization in the joint model facilitated model (patient) positioning as well as craniotomy and the extent of resection planning respecting case-dependent specifications. The advanced physical model allowed brain tumor surgery training including skin incision; craniotomy; dural opening; fluorescence-guided tumor resection; and dura, bone, and skin closure. CONCLUSIONS: Combining mixed reality visualization with the corresponding 3D printed physical hands-on model allowed advanced training of sequential brain tumor resection skills. Three-dimensional printing technology facilitates the production of a precise, reproducible, and worldwide accessible brain tumor surgery model. The described model for brain tumor resection advanced regarding important aspects of skills training for neurosurgical residents (e.g., locating the lesion, head position planning, skull trepanation, dura opening, tissue ablation techniques, fluorescence-guided resection, and closure). Mixed reality enriches the model with important structures that are difficult to model (e.g., vessels and fiber tracts) and advanced interaction concepts (e.g., craniotomy simulations). Finally, this concept demonstrates a bridging technology toward intraoperative application of mixed reality.

Mixed reality compared to the traditional ex cathedra format for neuroanatomy learning: the value of a three-dimensional virtual environment to better understand the real world.

OBJECTIVE: Neuroanatomy comprehension is a keystone of understanding intracranial surgeries. Traditionally taught to students during ex cathedra courses, neuroanatomy is described as complex. Mixed reality (MxR) opens new perspectives in the learning process. This study aims to compare MxR-based courses with traditional ex cathedra lectures for neuroanatomy education. METHODS: Two lectures describing the neuroanatomy of the anterior circulation arteries ("Vascular Lecture" [VS]) and important white matter fiber tracts ("White Fibers Lecture" [WF]) were designed and delivered in ex cathedra and MxR-based formats with the same audio content. Ninety-one medical students were randomly assigned to group A (ex cathedra WF/MxR VS) or group B (MxR WF/ex cathedra VS). The MxR content was delivered via MxR goggles. Prior to each lecture, students took a 10-item multiple choice question (MCQ) pretest. After the lectures, students took a 20-item MCQ posttest (75% neuroanatomy, 25% clinical correlation). RESULTS: The pretest scores showed no statistical difference between groups. Median posttest scores increased by 14.3% after using the MxR-based format compared to the ex cathedra format (16.00 [13.0, 18.0] vs 14.0 [11.0, 17.0], respectively, p < 0.01). Regarding the VS, students scored 21.7% better using the MxR format compared to the ex cathedra format (14.0 [12.0, 16.0] vs 11.5 [10.0, 14.0], p < 0.001). Concerning the WF, the median score using MxR was 18.0 (17.0, 19.0), and the median score using the ex cathedra format was 17.0 (16.0, 18.0; p < 0.01). Students showed high motivation to learn neuroanatomy in the future using MxR (74%) rather than ex cathedra format (25%; p < 0.001). Mild discomfort using the MxR goggles was reported by 48.3% of participants. Most participants (95.5%) preferred the MxR-based teaching. CONCLUSIONS: Students acquired a better knowledge of the anatomy of the anterior circulation arteries and white fiber tracts using MxR-based teaching as compared to the standard ex cathedra format. The perception of lecture quality and learning motivation was better using MxR-based teaching despite some mild discomfort. The development of MxR-based solutions is promising to improve neuroanatomy education.

Mixed reality in neurosurgery: redefining the paradigm for arteriovenous malformation planning and navigation to improve patient outcomes.

OBJECTIVE: Brain arteriovenous malformations (AVMs) present significant challenges in neurosurgery, requiring detailed planning and execution. In this study, the authors aimed to evaluate the efficacy of mixed reality (MxR), a synergistic application of virtual reality (VR) and augmented reality (AR), in the surgical management of AVMs. METHODS: A retrospective review was conducted on 10 patients who underwent AVM resection between 2021 and 2023. Preoperative planning used patient-specific 360° VR models, while intraoperative guidance used AR markers for targeted disconnection of arterial feeders. Data were analyzed for surgical duration, blood loss, and postoperative outcomes, stratified by Spetzler-Martin (SM) and supplemented Spetzler-Martin (Supp-SM) grades. RESULTS: In 10 patients with cerebral AVMs, MxR significantly facilitated the identification of 21 arterial feeders, including challenging deep feeders. MxR-assisted surgeries demonstrated efficient identification and disconnection of arterial feeders, contributing to precise AVM resection. The mean surgical duration was approximately 5 hours 11 minutes, with a mean intraoperative blood loss of 507.5 ml. Statistically significant variations in surgical duration and blood loss were observed based on SM and supplemented Supp-SM grades. Two patients experienced worsened postoperative neurological deficits, underscoring the inherent risks of AVM surgeries. The marked difference in hospital stays between patients with ruptured and those with unruptured AVMs, particularly for SM grade III, highlights the significant impact of rupture status on postoperative recovery. CONCLUSIONS: In this study, the authors delineated a novel paradigm using MxR for the surgical intervention of AVMs. Using 3D VR for preoperative planning and AR for intraoperative guidance, they achieved unparalleled precision and efficiency in targeting deep arterial feeders. While the results are promising, larger studies are needed to further validate this approach.

Extended reality in cranial and spinal neurosurgery - a bibliometric analysis.

PURPOSE: This bibliometric analysis of the top 100 cited articles on extended reality (XR) in neurosurgery aimed to reveal trends in this research field. Gender differences in authorship and global distribution of the most-cited articles were also addressed. METHODS: A Web of Science electronic database search was conducted. The top 100 most-cited articles related to the scope of this review were retrieved and analyzed for trends in publications, journal characteristics, authorship, global distribution, study design, and focus areas. After a brief description of the top 100 publications, a comparative analysis between spinal and cranial publications was performed. RESULTS: From 2005, there was a significant increase in spinal neurosurgery publications with a focus on pedicle screw placement. Most articles were original research studies, with an emphasis on augmented reality (AR). In cranial neurosurgery, there was no notable increase in publications. There was an increase in studies assessing both AR and virtual reality (VR) research, with a notable emphasis on VR compared to AR. Education, surgical skills assessment, and surgical planning were more common themes in cranial studies compared to spinal studies. Female authorship was notably low in both groups, with no significant increase over time. The USA and Canada contributed most of the publications in the research field. CONCLUSIONS: Research regarding the use of XR in neurosurgery increased significantly from 2005. Cranial research focused on VR and resident education while spinal research focused on AR and neuronavigation. Female authorship was underrepresented. North America provides most of the high-impact research in this area.

How I do it? Surgical clipping of a large right internal carotid artery-superior hypophyseal artery aneurysm.

BACKGROUND: Microsurgery alone often proves to be challenging in treating paraclinoid internal carotid artery (ICA) aneurysms, which are known for their complex anatomy. METHOD: A 53-year-old female with a large right ICA-superior hypophyseal artery (SHA) aneurysm underwent clipping repair. Mixed reality technology was utilized in the preoperative planning and anatomical study. During the surgery, the anterior clinoid process was removed intradurally to improve access to the aneurysm neck. The aneurysm was then secured with a long curved clip. The patient's recovery was successful without any complications. CONCLUSION: This report aims to shed light on the intricacies involved in clipping ICA-SHA aneurysms.

Effectiveness of mixed reality-based rehabilitation on hands and fingers by individual finger-movement tracking in patients with stroke.

BACKGROUND: Mixed reality (MR) is helpful in hand training for patients with stroke, allowing them to fully submerge in a virtual space while interacting with real objects. The recognition of individual finger movements is required for MR rehabilitation. This study aimed to assess the effectiveness of updated MR-board 2, adding finger training for patients with stroke. METHODS: Twenty-one participants with hemiplegic stroke (10 with left hemiplegia and 11 with right hemiplegia; nine female patients; 56.7 ± 14.2 years of age; and onset of stroke 32.7 ± 34.8 months) participated in this study. MR-board 2 comprised a board plate, a depth camera, plastic-shaped objects, a monitor, a palm-worn camera, and seven gamified training programs. All participants performed 20 self-training sessions involving 30-min training using MR-board 2. The outcome measurements for upper extremity function were the Fugl-Meyer assessment (FMA) upper extremity score, repeated number of finger flexion and extension (Repeat-FE), the thumb opposition test (TOT), Box and Block Test score (BBT), Wolf Motor Function Test score (WMFT), and Stroke Impact Scale (SIS). One-way repeated measures analysis of variance and the post hoc test were applied for the measurements. MR-board 2 recorded the fingers' active range of motion (AROM) and Dunnett's test was used for pairwise comparisons. RESULTS: Except for the FMA-proximal score (p = 0.617) and TOT (p = 0.005), other FMA scores, BBT score, Repeat-FE, WMFT score, and SIS stroke recovery improved significantly (p < 0.001) during MR-board 2 training and were maintained until follow-up. All AROM values of the finger joints changed significantly during training (p < 0.001). CONCLUSIONS: MR-board 2 self-training, which includes natural interactions between humans and computers using a tangible user interface and real-time tracking of the fingers, improved upper limb function across impairment, activity, and participation. MR-board 2 could be used as a self-training tool for patients with stroke, improving their quality of life. TRIAL REGISTRATION NUMBER: This study was registered with the Clinical Research Information Service (CRIS: KCT0004167).