High-precision tumor resection down to few-cell level guided by NIR-IIb molecular fluorescence imaging.

In vivo fluorescence/luminescence imaging in the near-infrared-IIb (NIR-IIb, 1,500 to 1,700 nm) window under <1,000 nm excitation can afford subcentimeter imaging depth without any tissue autofluorescence, promising high-precision intraoperative navigation in the clinic. Here, we developed a compact imager for concurrent visible photographic and NIR-II (1,000 to 3,000 nm) fluorescence imaging for preclinical image-guided surgery. Biocompatible erbium-based rare-earth nanoparticles (ErNPs) with bright down-conversion luminescence in the NIR-IIb window were conjugated to TRC105 antibody for molecular imaging of CD105 angiogenesis markers in 4T1 murine breast tumors. Under a ∼940 ± 38 nm light-emitting diode (LED) excitation, NIR-IIb imaging of 1,500- to 1,700-nm emission afforded noninvasive tumor­to­normal tissue (T/NT) signal ratios of ∼40 before surgery and an ultrahigh intraoperative tumor-to-muscle (T/M) ratio of ∼300, resolving tumor margin unambiguously without interfering background signal from surrounding healthy tissues. High-resolution imaging resolved small numbers of residual cancer cells during surgery, allowing thorough and nonexcessive tumor removal at the few-cell level. NIR-IIb molecular imaging afforded 10-times-higher and 100-times-higher T/NT and T/M ratios, respectively, than imaging with IRDye800CW-TRC105 in the ∼900- to 1,300-nm range. The vastly improved resolution of tumor margin and diminished background open a paradigm of molecular imaging-guided surgery.

Ultrabright NIR-II Nanoprobe for Image-Guided Accurate Resection of Tiny Metastatic Lesions.

Fluorescence imaging is a vital way to delineate the tumor boundaries. Here, we achieve a NIR-II aggregation-induced emission luminogen (AIEgen) with a fluorescence quantum yield (QY) of 12.6% in water through straightforward alkyl side chain modification. After loading of NIR-II AIEgen into polystyrene (PS) nanospheres, the thermal deactivation pathway is extremely limited, thereby concentrating absorption excitation on fluorescence emission. The fluorescence intensity is further enhanced by 5.4 times, the QY increases to 21.1%, and the NIR-II imaging signal is accordingly enhanced by 8.7 times, surpassing conventional DSPE-PEG carriers. The NIR-II@PS nanoprobe showcases superior resolution and tissue penetration depth compared to indocyanine green (ICG) and short-range near-infrared AIEgens. In vivo investigations underscore its tumor-to-normal tissue ratio (3.9) at 24 h post intravenous injection, enabling complete resection of ≤1 mm metastases under NIR-II bioimaging guidance. Additionally, the PS carrier-nanoparticles exhibit low toxicity in vivo, laying a promising foundation for the future design of medical nanomaterials.

Current Application of Navigation Systems in Robotic-Assisted and Laparoscopic Partial Nephrectomy: Focus on the Improvement of Surgical Performance and Outcomes.

Kidney cancer represents the third most prevalent malignancy among all types of genitourinary cancer worldwide. Currently, there is a growing trend of employing partial nephrectomy for the management of large and complex tumors. Surgical outcomes are associated with some amendable surgical factors, including warm ischemic time, pedicle clamping, preserved volume of renal parenchyma, appropriate surgical strategy, and precise resection of the tumor. Improving surgical performance is pivotal for achieving favorable surgical outcomes. Due to advancements in imaging visualization technology and the shift of the medical paradigm toward precision medicine, an increasing number of navigation systems have been implemented in partial nephrectomy procedures. The navigation system can assist surgeons in formulating optimal surgical strategies and enhance the safety, precision, and feasibility of resecting complex renal tumors. In this review, we provide an overview of currently available navigation systems and their feasible applications, with a focus on how they contribute to the improvement of surgical performance and outcomes during robotic-assisted and laparoscopic partial nephrectomy.

Lessons learned in application driven imaging agent design for image-guided surgery.

To meet the growing demand for intraoperative molecular imaging, the development of compatible imaging agents plays a crucial role. Given the unique requirements of surgical applications compared to diagnostics and therapy, maximizing translational potential necessitates distinctive imaging agent designs. For effective surgical guidance, exogenous signatures are essential and are achievable through a diverse range of imaging labels such as (radio)isotopes, fluorescent dyes, or combinations thereof. To achieve optimal in vivo utility a balanced molecular design of the tracer as a whole is required, which ensures a harmonious effect of the imaging label with the affinity and specificity (e.g., pharmacokinetics) of a pharmacophore/targeting moiety. This review outlines common design strategies and the effects of refinements in the molecular imaging agent design on the agent's pharmacological profile. This includes the optimization of affinity, pharmacokinetics (including serum binding and target mediated background), biological clearance route, the achievable signal intensity, and the effect of dosing hereon.

Current clinical applications of Cerenkov luminescence for intraoperative molecular imaging.

BACKGROUND: Cerenkov luminescence imaging (CLI) is a new emerging technology that can be used for optical imaging of approved radiotracers, both in a preclinical, and even more recently, in a clinical context with rapid imaging times, low costs, and detection in real-time (Grootendorst et al. Clin Transl Imaging 4(5):353-66, 2016); Wang et al. Photonics 9(6):390, 2022). This brief review provides an overview of clinical applications of CLI with a focus on intraoperative margin assessment (IMA) to address shortcomings and provide insight for future work in this application. METHODS: A literature review was performed using PubMed using the search words Cerenkov luminescence imaging (CLI), intraoperative margin assessment (IMA), and image-guided surgery. Articles were selected based on title, abstract, content, and application. RESULTS: Original research was summarized to examine advantages and limitations of CLI compared to other modalities for IMA. The characteristics of Cerenkov luminescence (CL) are defined, and results from relevant clinical trials are discussed. Prospects of ongoing clinical trials are reviewed, along with technological advancements related to CLI. CONCLUSION: CLI is a proven method for molecular imaging and shows feasibility for determining intraoperative margins if future work involves establishing quantitative approaches for attenuation and scattering, depth analysis, and radiation safety for CLI at a larger scale.

First-in-human validation of a DROP-IN ß-probe for robotic radioguided surgery: defining optimal signal-to-background discrimination algorithm.

PURPOSE: In radioguided surgery (RGS), radiopharmaceuticals are used to generate preoperative roadmaps (e.g., PET/CT) and to facilitate intraoperative tracing of tracer avid lesions. Within RGS, there is a push toward the use of receptor-targeted radiopharmaceuticals, a trend that also has to align with the surgical move toward minimal invasive robotic surgery. Building on our initial ex vivo evaluation, this study investigates the clinical translation of a DROP-IN ß probe in robotic PSMA-guided prostate cancer surgery. METHODS: A clinical-grade DROP-IN ß probe was developed to support the detection of PET radioisotopes (e.g., 68 Ga). The prototype was evaluated in 7 primary prostate cancer patients, having at least 1 lymph node metastases visible on PSMA-PET. Patients were scheduled for radical prostatectomy combined with extended pelvic lymph node dissection. At the beginning of surgery, patients were injected with 1.1 MBq/kg of [68Ga]Ga-PSMA. The ß probe was used to trace PSMA-expressing lymph nodes in vivo. To support intraoperative decision-making, a statistical software algorithm was defined and optimized on this dataset to help the surgeon discriminate between probe signals coming from tumors and healthy tissue. RESULTS: The DROP-IN ß probe helped provide the surgeon with autonomous and highly maneuverable tracer detection. A total of 66 samples (i.e., lymph node specimens) were analyzed in vivo, of which 31 (47%) were found to be malignant. After optimization of the signal cutoff algorithm, we found a probe detection rate of 78% of the PSMA-PET-positive samples, a sensitivity of 76%, and a specificity of 93%, as compared to pathologic evaluation. CONCLUSION: This study shows the first-in-human use of a DROP-IN ß probe, supporting the integration of ß radio guidance and robotic surgery. The achieved competitive sensitivity and specificity help open the world of robotic RGS to a whole new range of radiopharmaceuticals.

Molecular image-guided surgery in gynaecological cancer: where do we stand?

PURPOSE: The aim of this review is to give an overview of the current status of molecular image-guided surgery in gynaecological malignancies, from both clinical and technological points of view. METHODS: A narrative approach was taken to describe the relevant literature, focusing on clinical applications of molecular image-guided surgery in gynaecology, preoperative imaging as surgical roadmap, and intraoperative devices. RESULTS: The most common clinical application in gynaecology is sentinel node biopsy (SNB). Other promising approaches are receptor-target modalities and occult lesion localisation. Preoperative SPECT/CT and PET/CT permit a roadmap for adequate surgical planning. Intraoperative detection modalities span from 1D probes to 2D portable cameras and 3D freehand imaging. CONCLUSION: After successful application of radio-guided SNB and SPECT, innovation is leaning towards hybrid modalities, such as hybrid tracer and fusion of imaging approaches including SPECT/CT and PET/CT. Robotic surgery, as well as augmented reality and virtual reality techniques, is leading to application of these innovative technologies to the clinical setting, guiding surgeons towards a precise, personalised, and minimally invasive approach.

New EAU/ASCO guideline recommendations on sentinel node biopsy for penile cancer and remaining challenges from a nuclear medicine perspective.

INTRODUCTION: The European Association of Urology (EAU) and the American Society of Clinical Oncology (ASCO) recently issued updated guidelines on penile cancer, emphasising dynamic sentinel node biopsy (DSNB) as the preferred method for surgical staging among patients with invasive penile tumours and no palpable inguinal lymphadenopathy. This paper outlines the rationale behind this new recommendation and describes remaining challenges, as well as strategies for promoting DSNB worldwide. MAIN TEXT: DSNB offers high diagnostic accuracy with the lowest postoperative complications compared to open or minimally invasive inguinal lymph node dissection (ILND), prompting its preference in the new guidelines. Nevertheless, despite its advantages, there are challenges hampering the widespread adoption of DSNB. This includes the false-negative rate associated with DSNB and the potential negative impact on patient outcome. To address this issue, improvements should be made in several areas, including refining the timing and interpretation of the lymphoscintigraphy and the single photon emission computed tomography/computed tomography images. In addition, the quantity of tracer employed and choice of the injection site for the radiopharmaceutical should be optimised. Finally, limiting the removal of nodes without tracer activity during surgery may help minimise complication rates. CONCLUSION: Over the years, DSNB has evolved significantly, related to the dedicated efforts and innovations in nuclear medicine and subsequent clinical studies validating its efficacy. It is now strongly recommended for surgical staging among selected penile cancer patients. To optimise DSNB further, multidisciplinary collaborative research is required to improve SN identification for better diagnostic accuracy and fewer complications.

Surgical radioguidance with beta-emitting radionuclides; challenges and possibilities: A position paper by the EANM.

Radioguidance that makes use of ß-emitting radionuclides is gaining in popularity and could have potential to strengthen the range of existing radioguidance techniques. While there is a strong tendency to develop new PET radiotracers, due to favorable imaging characteristics and the success of theranostics research, there are practical challenges that need to be overcome when considering use of ß-emitters for surgical radioguidance. In this position paper, the EANM identifies the possibilities and challenges that relate to the successful implementation of ß-emitters in surgical guidance, covering aspects related to instrumentation, radiation protection, and modes of implementation.

Increasing the Dye Payload of Cetuximab-IRDye800CW Enables Photodynamic Therapy.

Cetuximab (Cet)-IRDye800CW, among other antibody-IRDye800CW conjugates, is a potentially effective tool for delineating tumor margins during fluorescence image-guided surgery (IGS). However, residual disease often leads to recurrence. Photodynamic therapy (PDT) following IGS is proposed as an approach to eliminate residual disease but suffers from a lack of molecular specificity for cancer cells. Antibody-targeted PDT offers a potential solution for this specificity problem. In this study, we show, for the first time, that Cet-IRDye800CW is capable of antibody-targeted PDT in vitro when the payload of dye molecules is increased from 2 (clinical version) to 11 per antibody. Cet-IRDye800CW (1:11) produces singlet oxygen, hydroxyl radicals, and peroxynitrite upon activation with 810 nm light. In vitro assays on FaDu head and neck cancer cells confirm that Cet-IRDye800CW (1:11) maintains cancer cell binding specificity and is capable of inducing up to ∼90% phototoxicity in FaDu cancer cells. The phototoxicity of Cet-IRDye800CW conjugates using 810 nm light follows a dye payload-dependent trend. Cet-IRDye800CW (1:11) is also found to be more phototoxic to FaDu cancer cells and less toxic in the dark than the approved chromophore indocyanine green, which can also act as a PDT agent. We propose that antibody-targeted PDT using high-payload Cet-IRDye800CW (1:11) could hold potential for eliminating residual disease postoperatively when using sustained illumination devices, such as fiber optic patches and implantable surgical bed balloon applicators. This approach could also potentially be applicable to a wide variety of resectable cancers that are amenable to IGS-PDT, using their respective approved full-length antibodies as a template for high-payload IRDye800CW conjugation.

Focal therapy with high-intensity focused ultrasound for prostate cancer: 3-year outcomes from a prospective trial.

OBJECTIVE: To assess the oncological and functional outcomes of focal high-intensity focused ultrasound (HIFU) in treating localised prostate cancer (PCa), a 3-year prospective study was undertaken using periodic post-ablation saturation biopsies. PATIENTS AND METHODS: Men with two or fewer lesions of grade group (GG) ≤3 PCa were eligible for participation. Additional criteria included a prostate-specific antigen (PSA) level of ≤15 ng/mL, clinical T1c-T2, and a life expectancy of ≥10 years. The primary endpoint was failure-free survival (FFS), defined as absence of clinically significant PCa (csPCa) in- or out-of-field on protocol-mandated saturation biopsy, no whole-gland or systemic salvage treatment, PCa metastasis, or PCa-related death. Results are reported using two distinct definitions of csPCa: (i) the presence of any GG ≥2 and (ii) any GG ≥3 or core involvement of ≥6 mm. Secondary endpoints were functional patient-reported outcome measures addressing urinary, sexual, and bowel function. RESULTS: A total of 91 patients were included: six (7%) with GG1 and 85 (93%) with GG ≥2. In all, 83 (91%) underwent at least one follow-up biopsy. Biopsy attendance at 6, 12, and 36 months was 84%, 67%, and 51%, respectively. The FFS at these time points for any GG ≥2 PCa was 79% (95% confidence interval [CI] 80-88%), 57% (95% CI 48-69%) and 44% (95% CI 34-56%), respectively. Using the second definition, FFS were 88% (95% CI 81-95%), 70% (95% CI 61-81%) and 65% (95% CI 55-77%), respectively. The 3-year cancer-specific survival was 100%, and freedom from metastasis was 99%. Magnetic resonance imaging (MRI) (negative predictive value of up to 89%, 95% CI 84-93%) and relative decrease of PSA values (P = 0.4) performed poorly in detecting residual disease. Urinary and bowel assessment returned to baseline questionnaire scores within 3 months. In all, 17 (21%) patients reported meaningful worsening in erectile function. A significant decrease of PCa related anxiety was observed. CONCLUSIONS: Focal HIFU treatment for localised PCa shows excellent functional outcomes with half of the patients remaining cancer-free after 3 years. Whole-gland treatment was avoided in 81%. Early follow-up biopsies are crucial to change or continue the treatment modality at the right time, while the use of MRI and PSA in detecting PCa recurrence is uncertain.

Real-time quantification of laser speckle contrast imaging during intestinal laparoscopic surgery: successful demonstration in a porcine intestinal ischemia model.

BACKGROUND: Anastomotic leakage (AL) is a dreaded complication following colorectal cancer surgery, impacting patient outcome and leads to increasing healthcare consumption as well as economic burden. Bowel perfusion is a significant modifiable factor for anastomotic healing and thus crucial for reducing AL. AIMS: The study aimed to calculate a cut-off value for quantified laser speckle perfusion units (LSPUs) in order to differentiate between ischemic and well-perfused tissue and to assess inter-observer reliability. METHODS: LSCI was performed using a porcine ischemic small bowel loop model with the PerfusiX-Imaging® system. An ischemic area, a well-perfused area, and watershed areas, were selected based on the LSCI colormap. Subsequently, local capillary lactate (LCL) levels were measured. A logarithmic curve estimation tested the correlation between LSPU and LCL levels. A cut-off value for LSPU and lactate was calculated, based on anatomically ischemic and well-perfused tissue. Inter-observer variability analysis was performed with 10 observers. RESULTS: Directly after ligation of the mesenteric arteries, differences in LSPU values between ischemic and well-perfused tissue were significant (p < 0.001) and increased significantly throughout all following measurements. LCL levels were significantly different (p < 0.001) at both 60 and 120 min. Logarithmic curve estimation showed an R2 value of 0.56 between LSPU and LCL values. A LSPU cut-off value was determined at 69, with a sensitivity of 0.94 and specificity of 0.87. A LCL cut-off value of 3.8 mmol/L was found, with a sensitivity and specificity of 0.97 and 1.0, respectively. There was no difference in assessment between experienced and unexperienced observers. Cohen's Kappa values were moderate to good (0.52-0.66). CONCLUSION: Real-time quantification of LSPUs may be a feasible intraoperative method to assess tissue perfusion and a cut-off value could be determined with high sensitivity and specificity. Inter-observer variability was moderate to good, irrespective of prior experience with the technique.

Ultrasound-guided robotic surgical procedures: a systematic review.

INTRODUCTION: Ultrasound has been nicknamed "the surgeon's stethoscope". The advantages of laparoscopic ultrasound beyond a substitute for the sense of touch are considerable, especially for robotic surgery. Being able to see through parenchyma and into vascular structures enables to avoid unnecessary dissection by providing a thorough assessment at every stage without the need for contrast media or ionising radiation. The limitations of restricted angulation and access within the abdominal cavity during laparoscopy can be overcome by robotic handling of miniaturised ultrasound probes and the use of various and specific frequencies will meet tissue- and organ-specific characteristics. The aim of this systematic review was to assess the reported applications of intraoperative ultrasound-guided robotic surgery and to outline future perspectives. METHODS: The study adhered to the PRISMA guidelines. PubMed, Google Scholar, ScienceDirect and ClinicalTrials.gov were searched up to October 2023. Manuscripts reporting data on ultrasound-guided robotic procedures were included in the qualitative analysis. RESULTS: 20 studies met the inclusion criteria. The majority (53%) were related to the field of general surgery during liver, pancreas, spleen, gallbladder/bile duct, vascular and rectal surgery. This was followed by other fields of oncological surgery (42%) including urology, lung surgery, and retroperitoneal lymphadenectomy for metastases. Among the studies, ten (53%) focused on locating tumoral lesions and defining resection margins, four (15%) were designed to test the feasibility of robotic ultrasound-guided surgery, while two (10.5%) aimed to compare robotic and laparoscopic ultrasound probes. Additionally two studies (10.5%) evaluated the robotic drop-in probe one (5%) assessed the hepatic tissue consistency and another one (5%) aimed to visualize the blood flow in the splenic artery. CONCLUSION: The advantages of robotic instrumentation, including ergonomics, dexterity, and precision of movements, are of relevance for robotic intraoperative ultrasound (RIOUS). The present systematic review demonstrates the virtue of RIOUS to support surgeons and potentially reduce minimally invasive procedure times.

Surgical optomics: hyperspectral imaging and deep learning towards precision intraoperative automatic tissue recognition-results from the EX-MACHYNA trial.

BACKGROUND: Hyperspectral imaging (HSI), combined with machine learning, can help to identify characteristic tissue signatures enabling automatic tissue recognition during surgery. This study aims to develop the first HSI-based automatic abdominal tissue recognition with human data in a prospective bi-center setting. METHODS: Data were collected from patients undergoing elective open abdominal surgery at two international tertiary referral hospitals from September 2020 to June 2021. HS images were captured at various time points throughout the surgical procedure. Resulting RGB images were annotated with 13 distinct organ labels. Convolutional Neural Networks (CNNs) were employed for the analysis, with both external and internal validation settings utilized. RESULTS: A total of 169 patients were included, 73 (43.2%) from Strasbourg and 96 (56.8%) from Verona. The internal validation within centers combined patients from both centers into a single cohort, randomly allocated to the training (127 patients, 75.1%, 585 images) and test sets (42 patients, 24.9%, 181 images). This validation setting showed the best performance. The highest true positive rate was achieved for the skin (100%) and the liver (97%). Misclassifications included tissues with a similar embryological origin (omentum and mesentery: 32%) or with overlaying boundaries (liver and hepatic ligament: 22%). The median DICE score for ten tissue classes exceeded 80%. CONCLUSION: To improve automatic surgical scene segmentation and to drive clinical translation, multicenter accurate HSI datasets are essential, but further work is needed to quantify the clinical value of HSI. HSI might be included in a new omics science, namely surgical optomics, which uses light to extract quantifiable tissue features during surgery.

Educational value of a novel telestration device for surgical coaching-a randomized controlled trial.

INTRODUCTION: Communication is fundamental to effective surgical coaching. This can be challenging for training during image-guided procedures where coaches and trainees need to articulate technical details on a monitor. Telestration devices that annotate on monitors remotely could potentially overcome these limitations and enhance the coaching experience. This study aims to evaluate the value of a novel telestration device in surgical coaching. METHODS: A randomized-controlled trial was designed. All participants watched a video demonstrating the task followed by a baseline performance assessment and randomization into either control group (conventional verbal coaching without telestration) or telestration group (verbal coaching with telestration). Coaching for a simulated laparoscopic small bowel anastomosis on a dry lab model was done by a faculty surgeon. Following the coaching session, participants underwent a post-coaching performance assessment of the same task. Assessments were recorded and rated by blinded reviewers using a modified Global Rating Scale of the Objective Structured Assessment of Technical Skills (OSATS). Coaching sessions were also recorded and compared in terms of mentoring moments; guidance misinterpretations, questions/clarifications by trainees, and task completion time. A 5-point Likert scale was administered to obtain feedback. RESULTS: Twenty-four residents participated (control group 13, telestration group 11). Improvements in some elements of the OSATS scale were noted in the Telestration arm but there was no statistical significance in the overall score between the two groups. Mentoring moments were more in the telestration Group. Amongst the telestration Group, 55% felt comfortable that they could perform this task independently, compared to only 8% amongst the control group and 82% would recommend the use of telestration tools here. CONCLUSION: There is demonstrated educational value of this novel telestration device mainly in the non-technical aspects of the interaction by enhancing the coaching experience with improvement in communication and greater mentoring moments between coach and trainee.

Improving the diagnosis and treatment of congenital heart disease through the combination of three-dimensional echocardiography and image guided surgery.

OBJECTIVE: The paper aimed to improve the accuracy limitations of traditional two-dimensional ultrasound and surgical procedures in the diagnosis and management of congenital heart disease (chd), and to improve the diagnostic and therapeutic level of chd. METHOD: This article first collected patient data through real-time imaging and body surface probes, and then diagnosed 150 patients using three-dimensional echocardiography. In order to verify the effectiveness of the combination therapy, 60 confirmed patients were divided into a control group and an experimental group. The control group received conventional two-dimensional ultrasound and surgical treatment, while the experimental group received three-dimensional ultrasound and image guided surgical treatment. RESULT: In the second diagnosis, the diagnostic accuracy of type 1, type 2, and type 3 in the control group was 84.21%, 84.02%, and 83.38%, respectively. The diagnostic accuracy rates of type 1, type 2, and type 3 in the experimental group were 92.73%, 92.82%, and 92.83%, respectively. In the control group, 2 males and 1 female experienced heart failure after surgery. However, in the experimental group, 0 males and 0 females experienced heart failure after surgery. CONCLUSION: The combination of three-dimensional echocardiography and image guided surgery can improve diagnostic accuracy and surgical treatment effectiveness, thereby reducing risks and complications, and improving surgical success rate.

Accuracy of routine external ventricular drain placement following a mixed reality-guided twist-drill craniostomy.

OBJECTIVE: The traditional freehand placement of an external ventricular drain (EVD) relies on empirical craniometric landmarks to guide the craniostomy and subsequent passage of the EVD catheter. The diameter and trajectory of the craniostomy physically limit the possible trajectories that can be achieved during the passage of the catheter. In this study, the authors implemented a mixed reality-guided craniostomy procedure to evaluate the benefit of an optimally drilled craniostomy to the accurate placement of the catheter. METHODS: Optical marker-based tracking using an OptiTrack system was used to register the brain ventricular hologram and drilling guidance for craniostomy using a HoloLens 2 mixed reality headset. A patient-specific 3D-printed skull phantom embedded with intracranial camera sensors was developed to automatically calculate the EVD accuracy for evaluation. User trials consisted of one blind and one mixed reality-assisted craniostomy followed by a routine, unguided EVD catheter placement for each of two different drill bit sizes. RESULTS: A total of 49 participants were included in the study (mean age 23.4 years, 59.2% female). The mean distance from the catheter target improved from 18.6 ± 12.5 mm to 12.7 ± 11.3 mm (p = 0.0008) using mixed reality guidance for trials with a large drill bit and from 19.3 ± 12.7 mm to 10.1 ± 8.4 mm with a small drill bit (p < 0.0001). Accuracy using mixed reality was improved using a smaller diameter drill bit compared with a larger bit (p = 0.039). Overall, the majority of the participants were positive about the helpfulness of mixed reality guidance and the overall mixed reality experience. CONCLUSIONS: Appropriate indications and use cases for the application of mixed reality guidance to neurosurgical procedures remain an area of active inquiry. While prior studies have demonstrated the benefit of mixed reality-guided catheter placement using predrilled craniostomies, the authors demonstrate that real-time quantitative and visual feedback of a mixed reality-guided craniostomy procedure can independently improve procedural accuracy and represents an important tool for trainee education and eventual clinical implementation.

Entirely robotic cochlear implant surgery.

INTRODUCTION: Robot-assisted cochlear implant surgery (RACIS) as defined by the HEARO®-procedure performs minimal invasive cochlear implant (CI) surgery by directly drilling a keyhole trajectory towards the inner ear. Hitherto, an entirely robotic automation including electrode insertion has not been described yet. The feasability of using a newly developed, dedicated motorised device for automated electrode insertion in the first clinical case of entirely robotic cochlear implant surgery was investigated. AIM: The aim is to report the first experience of entirely robotic cochlear implantation surgery. INTERVENTION: RACIS with a straight flexible lateral wall electrode. PRIMARY OUTCOME MEASUREMENTS: Electrode cochlear insertion depth. SECONDARY OUTCOME MEASUREMENTS: The audiological outcome in terms of mean hearing thresholds. CONCLUSION: Here, we report on a cochlear implant robot that performs the most complex surgical steps to place a cochlear implant array successfully in the inner ear and render similar audiological results as in conventional surgery. Robots can execute tasks beyond human dexterity and will probably pave the way to standardize residual hearing preservation and broadening the indication for electric-acoustic stimulation in the same ear with hybrid implants.

Tumor Segmentation in Intraoperative Fluorescence Images Based on Transfer Learning and Convolutional Neural Networks.

OBJECTIVE: To propose a transfer learning based method of tumor segmentation in intraoperative fluorescence images, which will assist surgeons to efficiently and accurately identify the boundary of tumors of interest. METHODS: We employed transfer learning and deep convolutional neural networks (DCNNs) for tumor segmentation. Specifically, we first pre-trained four networks on the ImageNet dataset to extract low-level features. Subsequently, we fine-tuned these networks on two fluorescence image datasets (ABFM and DTHP) separately to enhance the segmentation performance of fluorescence images. Finally, we tested the trained models on the DTHL dataset. The performance of this approach was compared and evaluated against DCNNs trained end-to-end and the traditional level-set method. RESULTS: The transfer learning-based UNet++ model achieved high segmentation accuracies of 82.17% on the ABFM dataset, 95.61% on the DTHP dataset, and 85.49% on the DTHL test set. For the DTHP dataset, the pre-trained Deeplab v3 + network performed exceptionally well, with a segmentation accuracy of 96.48%. Furthermore, all models achieved segmentation accuracies of over 90% when dealing with the DTHP dataset. CONCLUSION: To the best of our knowledge, this study explores tumor segmentation on intraoperative fluorescent images for the first time. The results show that compared to traditional methods, deep learning has significant advantages in improving segmentation performance. Transfer learning enables deep learning models to perform better on small-sample fluorescence image data compared to end-to-end training. This discovery provides strong support for surgeons to obtain more reliable and accurate image segmentation results during surgery.

Virtual Loupes: A Pilot Study on the Use of Video Passthrough Augmented Reality in Plastic Surgery.

BACKGROUND: Plastic surgeons use loupes or operative microscope to aid in tissue dissection and anastomosis of structures. These devices have their own limitations in areas of visualization and weight. Current uses of augmented and virtual reality in surgery have been limited to operative planning and simulation. We present a proof of concept that harnesses video passthrough AR technology to augment the capabilities of loupes. METHODS: We first evaluated methods of gaze-based eye tracking to enable digital magnification. Using the Varjo XR-1 mixed reality headset, we compared discrete zoom through displayed pop-up menu vs continuous zoom through eye winking. Six participants were recruited to perform skin suturing simulation and completed a survey and interview. Next we assessed the performance and limitations of AR digital magnification. Varjo XR-3 was utilized to address the hardware limitations. Participants performed anastomotic suturing tasks with progressively finer suture, then completed a survey and interview. FINDINGS: There was no strong preference between zoom methods, although participants felt the discrete zoom was easier to use. Participants had difficulty determining depth and visualizing the suture due to limitations of digital magnification. Using Wilcoxon rank sum test to examine differences in system usability scale, the Phase 2 user experience had significant difference in percentile distribution (P 0.0390). CONCLUSION: Virtual loupes may be a valuable tool for plastic surgeons, with potential for variable magnification and advanced visualization. Improvements in the hardware yielded higher ratings of system usability and user experience. Further development is needed to address the limitations of existing devices.