Visual extended reality tools in image-guided surgery in urology: a systematic review.

PURPOSE: The aim of this systematic review is to assess the clinical implications of employing various Extended Reality (XR) tools for image guidance in urological surgery. METHODS: In June 2023, a systematic electronic literature search was conducted using the Medline database (via PubMed), Embase (via Ovid), Scopus, and Web of Science. The search strategy was designed based on the PICO (Patients, Intervention, Comparison, Outcome) criteria. Study protocol was registered on PROSPERO (registry number CRD42023449025). We incorporated retrospective and prospective comparative studies, along with single-arm studies, which provided information on the use of XR, Mixed Reality (MR), Augmented Reality (AR), and Virtual Reality (VR) in urological surgical procedures. Studies that were not written in English, non-original investigations, and those involving experimental research on animals or cadavers were excluded from our analysis. The quality assessment of comparative and cohort studies was conducted utilizing the Newcastle-Ottawa scale, whilst for randomized controlled trials (RCTs), the Jadad scale was adopted. The level of evidence for each study was determined based on the guidelines provided by the Oxford Centre for Evidence-Based Medicine. RESULTS: The initial electronic search yielded 1,803 papers after removing duplicates. Among these, 58 publications underwent a comprehensive review, leading to the inclusion of 40 studies that met the specified criteria for analysis. 11, 20 and 9 studies tested XR on prostate cancer, kidney cancer and miscellaneous, including bladder cancer and lithiasis surgeries, respectively. Focusing on the different technologies 20, 15 and 5 explored the potential of VR, AR and MR. The majority of the included studies (i.e., 22) were prospective non-randomized, whilst 7 and 11 were RCT and retrospective studies respectively. The included studies that revealed how these new tools can be useful both in preoperative and intraoperative setting for a tailored surgical approach. CONCLUSIONS: AR, VR and MR techniques have emerged as highly effective new tools for image-guided surgery, especially for urologic oncology. Nevertheless, the complete clinical advantages of these innovations are still in the process of evaluation.

Metaverse Surgical Planning with Three-dimensional Virtual Models for Minimally Invasive Partial Nephrectomy.

The recent integration of new virtual visualization modalities with artificial intelligence and high-speed internet connection has opened the door to the advent of the metaverse in medicine. In this totally virtual environment, three-dimensional virtual models (3DVMs) of the patient's anatomy can be visualized and discussed via digital avatars. Here we present for the first time a metaverse preoperative clinical case discussion before minimally invasive partial nephrectomy. The surgeons' digital avatars met in a virtual room and participated in a virtual consultation on the surgical strategy and clamping approach before the procedure. Robotic or laparoscopic procedures are then carried out according to the simulated surgical strategy. We demonstrate how this immersive virtual reality experience overcomes the barriers of distance and how the quality of surgical planning is enriched by a great sense of "being there", even if virtually. Further investigation will improve the quality of interaction with the models and among the avatars.

3D Model Artificial Intelligence-Guided Automatic Augmented Reality Images during Robotic Partial Nephrectomy.

More than ever, precision surgery is making its way into modern surgery for functional organ preservation. This is possible mainly due to the increasing number of technologies available, including 3D models, virtual reality, augmented reality, and artificial intelligence. Intraoperative surgical navigation represents an interesting application of these technologies, allowing to understand in detail the surgical anatomy, planning a patient-tailored approach. Automatic superimposition comes into this context to optimally perform surgery as accurately as possible. Through a dedicated software (the first version) called iKidney, it is possible to superimpose the images using 3D models and live endoscopic images during partial nephrectomy, targeting the renal mass only. The patient is 31 years old with a 28 mm totally endophytic right-sided renal mass, with a PADUA score of 9. Thanks to the automatic superimposition and selective clamping, an enucleoresection of the renal mass alone was performed with no major postoperative complication (i.e., Clavien-Dindo < 2). iKidney-guided partial nephrectomy is safe, feasible, and yields excellent results in terms of organ preservation and functional outcomes. Further validation studies are needed to improve the prototype software, particularly to improve the rotational axes and avoid human help. Furthermore, it is important to reduce the costs associated with these technologies to increase its use in smaller hospitals.

Three-dimensional automatic artificial intelligence driven augmented-reality selective biopsy during nerve-sparing robot-assisted radical prostatectomy: A feasibility and accuracy study.

Objective: To evaluate the accuracy of our new three-dimensional (3D) automatic augmented reality (AAR) system guided by artificial intelligence in the identification of tumour's location at the level of the preserved neurovascular bundle (NVB) at the end of the extirpative phase of nerve-sparing robot-assisted radical prostatectomy. Methods: In this prospective study, we enrolled patients with prostate cancer (clinical stages cT1c-3, cN0, and cM0) with a positive index lesion at target biopsy, suspicious for capsular contact or extracapsular extension at preoperative multiparametric magnetic resonance imaging. Patients underwent robot-assisted radical prostatectomy at San Luigi Gonzaga Hospital (Orbassano, Turin, Italy), from December 2020 to December 2021. At the end of extirpative phase, thanks to our new AAR artificial intelligence driven system, the virtual prostate 3D model allowed to identify the tumour's location at the level of the preserved NVB and to perform a selective excisional biopsy, sparing the remaining portion of the bundle. Perioperative and postoperative data were evaluated, especially focusing on the positive surgical margin (PSM) rates, potency, continence recovery, and biochemical recurrence. Results: Thirty-four patients were enrolled. In 15 (44.1%) cases, the target lesion was in contact with the prostatic capsule at multiparametric magnetic resonance imaging (Wheeler grade L2) while in 19 (55.9%) cases extracapsular extension was detected (Wheeler grade L3). 3D AAR guided biopsies were negative in all pathological tumour stage 2 (pT2) patients while they revealed the presence of cancer in 14 cases in the pT3 cohort (14/16; 87.5%). PSM rates were 0% and 7.1% in the pathological stages pT2 and pT3 (<3 mm, Gleason score 3), respectively. Conclusion: With the proposed 3D AAR system, it is possible to correctly identify the lesion's location on the NVB in 87.5% of pT3 patients and perform a 3D-guided tailored nerve-sparing even in locally advanced diseases, without compromising the oncological safety in terms of PSM rates.

Outcomes of Cytoreductive Radical Prostatectomy for Oligometastatic Prostate Cancer on Prostate-specific Membrane Antigen Positron Emission Tomography: Results of a Multicenter European Study.

BACKGROUND: De novo oligometastatic prostate cancer (omPCa) on prostate-specific membrane antigen (PSMA) positron emission tomography (PET) is a new disease entity and its optimal management remains unknown. OBJECTIVE: To analyze the outcomes of patients treated with cytoreductive radical prostatectomy (cRP) for omPCa on PSMA-PET. DESIGN, SETTING, AND PARTICIPANTS: Overall, 116 patients treated with cRP at 13 European centers were identified. Oligometastatic PCa was defined as miM1a and/or miM1b with five or fewer osseous metastases and/or miM1c with three or fewer lung lesions on PSMA-PET. INTERVENTION: Cytoreductive radical prostatectomy. OUTCOME MEASUREMENTS AND STATISTICAL ANALYSIS: Thirty-day complications according to Clavien-Dindo, continence rates, time to castration-resistant PCa (CRPC), and overall survival (OS) were analyzed. RESULTS AND LIMITATIONS: Overall, 95 (82%) patients had miM1b, 18 (16%) miM1a, and three (2.6%) miM1c omPCa. The median prebiopsy prostate-specific antigen was 14 ng/ml, and 102 (88%) men had biopsy grade group ≥3 PCa. The median number of metastases on PSMA-PET was 2; 38 (33%), 29 (25%), and 49 (42%) patients had one, two, and three or more distant positive lesions. A total of 70 (60%) men received neoadjuvant systemic therapy, and 37 (32%) underwent metastasis-directed therapy. Any and Clavien-Dindo grade ≥3 complications occurred in 36 (31%) and six (5%) patients, respectively. At a median follow-up of 27 mo, 19 (16%) patients developed CRPC and eight (7%) patients died. The 1-yr urinary continence rate was 82%. The 2-yr CRPC-free survival and OS were 85.8% (95% confidence interval [CI] 78.5-93.7%) and 98.9% (95% CI 96.8-100%), respectively. The limitations include retrospective design and short-term follow-up. CONCLUSIONS: Cytoreductive radical prostatectomy is a safe and feasible treatment option in patients with de novo omPCa on PSMA-PET. Despite overall favorable oncologic outcomes, some of these patients have a non-negligible risk of early progression and thus should be considered for multimodal therapy. PATIENT SUMMARY: We found that patients treated at expert centers with surgery for prostate cancer, with a limited number of metastases detected using novel molecular imaging, have favorable short-term survival, functional results, and acceptable rates of complications.

Gesteme-free context-aware adaptation of robot behavior in human-robot cooperation.

BACKGROUND: Cooperative robotics is receiving greater acceptance because the typical advantages provided by manipulators are combined with an intuitive usage. In particular, hands-on robotics may benefit from the adaptation of the assistant behavior with respect to the activity currently performed by the user. A fast and reliable classification of human activities is required, as well as strategies to smoothly modify the control of the manipulator. In this scenario, gesteme-based motion classification is inadequate because it needs the observation of a wide signal percentage and the definition of a rich vocabulary. OBJECTIVE: In this work, a system able to recognize the user's current activity without a vocabulary of gestemes, and to accordingly adapt the manipulator's dynamic behavior is presented. METHODS AND MATERIAL: An underlying stochastic model fits variations in the user's guidance forces and the resulting trajectories of the manipulator's end-effector with a set of Gaussian distribution. The high-level switching between these distributions is captured with hidden Markov models. The dynamic of the KUKA light-weight robot, a torque-controlled manipulator, is modified with respect to the classified activity using sigmoidal-shaped functions. The presented system is validated over a pool of 12 näive users in a scenario that addresses surgical targeting tasks on soft tissue. The robot's assistance is adapted in order to obtain a stiff behavior during activities that require critical accuracy constraint, and higher compliance during wide movements. Both the ability to provide the correct classification at each moment (sample accuracy) and the capability of correctly identify the correct sequence of activity (sequence accuracy) were evaluated. RESULTS: The proposed classifier is fast and accurate in all the experiments conducted (80% sample accuracy after the observation of ∼450ms of signal). Moreover, the ability of recognize the correct sequence of activities, without unwanted transitions is guaranteed (sequence accuracy ∼90% when computed far away from user desired transitions). Finally, the proposed activity-based adaptation of the robot's dynamic does not lead to a not smooth behavior (high smoothness, i.e. normalized jerk score <0.01). CONCLUSION: The provided system is able to dynamic assist the operator during cooperation in the presented scenario.