Intraoperative laparoscopic photoacoustic image guidance system in the da Vinci surgical system.

This paper describes a framework allowing intraoperative photoacoustic (PA) imaging integrated into minimally invasive surgical systems. PA is an emerging imaging modality that combines the high penetration of ultrasound (US) imaging with high optical contrast. With PA imaging, a surgical robot can provide intraoperative neurovascular guidance to the operating physician, alerting them of the presence of vital substrate anatomy invisible to the naked eye, preventing complications such as hemorrhage and paralysis. Our proposed framework is designed to work with the da Vinci surgical system: real-time PA images produced by the framework are superimposed on the endoscopic video feed with an augmented reality overlay, thus enabling intuitive three-dimensional localization of critical anatomy. To evaluate the accuracy of the proposed framework, we first conducted experimental studies in a phantom with known geometry, which revealed a volumetric reconstruction error of 1.20 ± 0.71 mm. We also conducted an ex vivo study by embedding blood-filled tubes into chicken breast, demonstrating the successful real-time PA-augmented vessel visualization onto the endoscopic view. These results suggest that the proposed framework could provide anatomical and functional feedback to surgeons and it has the potential to be incorporated into robot-assisted minimally invasive surgical procedures.

Laparoscopic Photoacoustic Imaging System Based on Side-Illumination Diffusing Fibers.

OBJECTIVE: To develop a flexible miniaturized photoacoustic (PA) imaging probe for detecting anatomical structures during laparoscopic surgery. The proposed probe aimed to facilitate intraoperative detection of blood vessels and nerve bundles embedded in tissue not directly visible to the operating physician to preserve these delicate and vital structures. METHODS: We modified a commercially available ultrasound laparoscopic probe by incorporating custom-fabricated side-illumination diffusing fibers that illuminate the probe's field of view. The probe geometry, including the position and orientation of the fibers and the emission angle, was determined using computational models of light propagation in the simulation and subsequently validated through experimental studies. RESULTS: In wire phantom studies within an optical scattering medium, the probe achieved an imaging resolution of 0.43 ±0.09 mm and a signal-to-noise ratio of 31.2±1.84 dB. We also conducted an ex vivo study using a rat model, demonstrating the successful detection of blood vessels and nerves. CONCLUSION: Our results indicate the viability of a side-illumination diffusing fiber PA imaging system for guidance during laparoscopic surgery. SIGNIFICANCE: The potential clinical translation of this technology could enhance the preservation of critical vascular structures and nerves, thereby minimizing post-operative complications.

Benefits of Side-Firing Optical Fibers in Endoscopic Laser Treatment of the Larynx.

OBJECTIVE: To elucidate potential tissue coverage of side-firing optical fibers in office-based endoscopic laser treatment of larynx, as well as to demonstrate their enhanced ability to address challenging anatomic areas. METHOD: We performed a comparative study of four different fiber designs: a traditional forward-facing fiber, and three side-firing fibers that emit light at an angle of 45°, 70°, and 90°, respectively. The study was conducted in simulation, using eight three-dimensional models of the human larynx generated from microtomography x-ray scans. A computer program simulated the insertion of the endoscope into the larynx, and the Möller-Trumbore algorithm was used to simulate the application of laser light. RESULTS: Side-firing laser fibers increased potential tissue coverage by a mean of 50.2 (standard deviation [SD] 25.8), 73.8 (SD 41.3), and 84.0 (SD 47.6) percent for angles of 45°, 70°, and 90°, respectively, compared to forward-facing fibers. Angled fibers provided access to areas of the larynx considered difficult to address by traditional methods, including the infraglottis, laryngeal ventricle, and right vocal fold. CONCLUSION: Simulation results suggest that side-firing optical fibers have the potential to enhance anatomical access during in-office endoscopic laser procedures in the larynx. Further research is needed to better understand the benefits and any potential risks or contraindications of side-firing optical fibers. LEVEL OF EVIDENCE: NA Laryngoscope, 133:1205-1210, 2023.

Identification of tissue optical properties during thermal laser-tissue interactions: An ensemble Kalman filter-based approach.

In this article, we propose a computational framework to estimate the physical properties that govern the thermal response of laser-irradiated tissue. We focus in particular on two quantities, the absorption and scattering coefficients, which describe the optical absorption of light in the tissue and whose knowledge is vital to correctly plan medical laser treatments. To perform the estimation, we utilize an implementation of the ensemble Kalman filter (EnKF), a type of Bayesian filtering algorithm for data assimilation. Unlike prior approaches, in this work, we estimate the tissue optical properties based on observations of the tissue thermal response to laser irradiation. This method has the potential for straightforward implementation in a clinical setup, as it would only require a simple thermal sensor, for example, a miniaturized infrared camera. Because the optical properties of tissue can undergo shifts during laser exposure, we employ a variant of EnKF capable of tracking time-varying parameters. Through simulated experimental studies, we demonstrate the ability of the proposed technique to identify the tissue optical properties and track their dynamic changes during laser exposure, while simultaneously tracking changes in the tissue temperature at locations beneath the surface. We further demonstrate the framework's capability in estimating additional unknown tissue properties (i.e., the volumetric heat capacity and thermal conductivity) along with the optical properties of interest.

Transeustachian Middle Ear Endoscopy Using a Steerable Distal-Camera Tipped Endoscope.

OBJECTIVE: Demonstrate the ability of a novel steerable distal chip endoscope to traverse the Eustachian tube and provide diagnostic quality images of the human middle ear. PATIENTS: Three cadaveric temporal bone specimens were used in this work. INTERVENTION: Diagnostic transeustachian endoscopy of the middle ear was performed. MAIN OUTCOME MEASURE: Diagnostic image quality. RESULTS: A novel 1.62 mm steerable endoscope successfully cannulated the Eustachian tube of three human cadaveric temporal bone specimens to reveal intact middle ear anatomy with high optical clarity. CONCLUSIONS: A steerable endoscope can be designed to traverse the human Eustachian tube and provide diagnostic quality images of middle ear anatomy.

Light in the Larynx: a Miniaturized Robotic Optical Fiber for In-office Laser Surgery of the Vocal Folds.

This paper reports the design, construction, and experimental validation of a novel hand-held robot for in-office laser surgery of the vocal folds. In-office endoscopic laser surgery is an emerging trend in Laryngology: It promises to deliver the same patient outcomes of traditional surgical treatment (i.e., in the operating room), at a fraction of the cost. Unfortunately, office procedures can be challenging to perform; the optical fibers used for laser delivery can only emit light forward in a line-of-sight fashion, which severely limits anatomical access. The robot we present in this paper aims to overcome these challenges. The end effector of the robot is a steerable laser fiber, created through the combination of a thin optical fiber (ϕ 0.225 mm) with a tendon-actuated Nickel-Titanium notched sheath that provides bending. This device can be seamlessly used with most commercially available endoscopes, as it is sufficiently small (ϕ 1.1 mm) to pass through a working channel. To control the fiber, we propose a compact actuation unit that can be mounted on top of the endoscope handle, so that, during a procedure, the operating physician can operate both the endoscope and the steerable fiber with a single hand. We report simulation and phantom experiments demonstrating that the proposed device substantially enhances surgical access compared to current clinical fibers.

Optical Fiber Coupling System for Steerable Endoscopic Instruments.

In this paper, we present an optical coupling system that couples light from an Endostat fiber in a commercial laser surgical system into a smaller multimode fiber, in order to enable endoscopic probe steering in a tightly confined space. Unlike the Endostat fibers, which have a minimum bending radius of 12 mm due to the large diameter, our work allows the laser to be delivered by smaller fibers that can be readily bent at a 6-mm bending radius by a distal steerable mechanism. Such a readily achievable sharp bending facilitates the surgical laser to access hard-to-reach anatomies. We experimentally achieved an optical power coupling efficiency of ≈ 50%. Tissue ablation experiments were performed to prove the feasibility and potential of our light coupling system in clinical laser surgeries, as well as other optical fiber-based endoscopic medical devices.Clinical Relevance- Optical fibers are commonly used in laser-based surgical systems. The optical coupling system in this paper enables the laser to be delivered by small fibers, helps realize the fiber bending and steering, and hence allows the laser treatments of previous inaccessible anatomies.

µRALP and Beyond: Micro-Technologies and Systems for Robot-Assisted Endoscopic Laser Microsurgery.

Laser microsurgery is the current gold standard surgical technique for the treatment of selected diseases in delicate organs such as the larynx. However, the operations require large surgical expertise and dexterity, and face significant limitations imposed by available technology, such as the requirement for direct line of sight to the surgical field, restricted access, and direct manual control of the surgical instruments. To change this status quo, the European project µRALP pioneered research towards a complete redesign of current laser microsurgery systems, focusing on the development of robotic micro-technologies to enable endoscopic operations. This has fostered awareness and interest in this field, which presents a unique set of needs, requirements and constraints, leading to research and technological developments beyond µRALP and its research consortium. This paper reviews the achievements and key contributions of such research, providing an overview of the current state of the art in robot-assisted endoscopic laser microsurgery. The primary target application considered is phonomicrosurgery, which is a representative use case involving highly challenging microsurgical techniques for the treatment of glottic diseases. The paper starts by presenting the motivations and rationale for endoscopic laser microsurgery, which leads to the introduction of robotics as an enabling technology for improved surgical field accessibility, visualization and management. Then, research goals, achievements, and current state of different technologies that can build-up to an effective robotic system for endoscopic laser microsurgery are presented. This includes research in micro-robotic laser steering, flexible robotic endoscopes, augmented imaging, assistive surgeon-robot interfaces, and cognitive surgical systems. Innovations in each of these areas are shown to provide sizable progress towards more precise, safer and higher quality endoscopic laser microsurgeries. Yet, major impact is really expected from the full integration of such individual contributions into a complete clinical surgical robotic system, as illustrated in the end of this paper with a description of preliminary cadaver trials conducted with the integrated µRALP system. Overall, the contribution of this paper lays in outlining the current state of the art and open challenges in the area of robot-assisted endoscopic laser microsurgery, which has important clinical applications even beyond laryngology.

Bringing the light inside the body to perform better surgery.

Miniaturized robotic laser steering opens new horizons for laser microsurgery.

On the Merits of Using Angled Fiber Tips in Office-based Laser Surgery of the Vocal Folds.

Office-based endoscopic laser surgery is an increasingly popular option for the treatment of many benign and pre-malignant tumors of the vocal folds. While these procedures have been shown to be generally safe and effective, recent clinical studies have revealed that there are a number of challenging locations inside the larynx where laser light cannot be easily delivered due to line-of-sight limitations. In this paper, we explore whether these challenges can be overcome through the use of side-firing laser fibers. Our study is conducted in simulation, using three-dimensional models of the human larynx generated from X-ray microtomography scans. Using computer graphics techniques (ray-casting), we simulate the application of laser pulses with different types of laser fibers and compare the total anatomical coverage attained by each fiber. We consider four fiber types: a traditional "forward-looking" fiber - not unlike the ones currently used in clinical practice - and three side-firing fibers that emit light at an angle of 45, 70, and 90 degrees, respectively. Results show that side-firing fibers enable a ~70% increase in accessible anatomy compared to forward-looking fibers.

Beyond Constant Curvature: A New Mechanics Model for Unidirectional Notched-Tube Continuum Wrists.

This paper presents a new mechanics model for unidirectional notched-tube continuum wrists, a class of mechanisms frequently used to implement distal steering in needle-sized surgical robotic instruments. Existing kinematic models available for these devices are based on the simplifying assumption that, during actuation, all the notches undergo the same amount of deflection, so that the shape of a wrist can be approximated by an arc of constant curvature. This approach is analytically attractive, but, as we show in this paper, it can sometimes fail to provide good tracking accuracy. In this article, we provide a new model that relaxes the assumption above, and we report experimental evidence showing its superior accuracy. We model wrist deflection using Castigliano's second theorem, with the addition of a capstan friction term that accounts for frictional losses on the actuation tendon. Because notched-tube wrists are typically made of Nickel-Titanium (Nitinol), which has nonlinear stress-strain characteristics, we use a technique to obtain a local linearized approximation of the material modulus, suitable for use in the deflection model. The result of our modeling is a system of nonlinear equations that can be solved numerically to predict the wrist configuration based on the applied actuation force. Experimental results on physical specimens show that this improved model provides a more accurate estimate of wrist kinematics than prior models assuming constant curvature bending.

Eyes in Ears: A Miniature Steerable Digital Endoscope for Trans-Nasal Diagnosis of Middle Ear Disease.

The aim of this work is to design, fabricate and experimentally validate a miniature steerable digital endoscope that can provide comprehensive, high-resolution imaging of the middle ear using a trans-nasal approach. The motivation for this work comes from the high incidence of middle ear diseases, and the current reliance on invasive surgery to diagnose and survey these diseases which typically consists of the eardrum being lifted surgically to directly visualize the middle ear using a trans-canal approach. To enable less-invasive diagnosis and surveillance of middle ear disease, we propose an endoscope that is small enough to pass into the middle ear through the Eustachian tube, with a steerable tip that carries a 1 Megapixel image sensor and fiber-optic illumination to provide high-resolution visualization of critical middle ear structures. The proposed endoscope would enable physicians to diagnose middle ear disease using a non-surgical trans-nasal approach instead, enabling such procedures to be performed in an office setting and greatly reducing invasiveness for the patient. In this work, the computational design of the steerable tip based on computed tomography models of real human middle ear anatomy is presented, and these results informed the fabrication of a clinical-scale steerable endoscope prototype. The prototype was used in a pilot study in three cadaveric temporal bone specimens, where high-quality middle ear visualization was achieved as determined by an unbiased cohort of otolaryngologists. This is the first paper to demonstrate cadaveric validation of a digital, steerable, clinical-scale endoscope for middle ear disease diagnosis, and the experimental results illustrate that the endoscope enables the visualization of critical middle ear structures (such as the epitympanum or sinus tympani) that were seldom or never visualized in prior published trans-Eustachian tube endoscopy feasibility studies.

Computational Optimization of Notch Spacing for a Transnasal Ear Endoscopy Continuum Robot.

This paper presents a computational framework to optimize the visual coverage attainable by a notched-tube continuum robotic endoscope inside the middle ear cavity. Our framework combines anatomically-accurate geometric (mesh) models of the middle ear with a sampling-based motion planning algorithm (RRT) and a ray-casting procedure to quantify what regions of the middle ear can be accessed and visualized by the endoscope. To demonstrate the use of this framework, we run computer simulations to investigate the effect of varying the distance between each pair of consecutive flexure elements (i.e., notches) in our robotic endoscope.

Through the Eustachian Tube and Beyond: A New Miniature Robotic Endoscope to See Into The Middle Ear.

This paper presents a novel miniature robotic endoscope that is small enough to pass through the Eustachian tube and provide visualization of the middle ear (ME). The device features a miniature bending tip previously conceived of as a small-scale robotic wrist that has been adapted to carry and aim a small chip-tip camera and fiber optic light sources. The motivation for trans-Eustachian tube ME inspection is to provide a natural-orifice-based route to the ME that does not require cutting or lifting the eardrum, as is currently required. In this paper, we first perform an analysis of the ME anatomy and use a computational design optimization platform to derive the kinematic requirements for endoscopic inspection of the ME through the Eustachian tube. Based on these requirements, we fabricate the proposed device and use it to demonstrate the feasibility of ME inspection in an anthropomorphic model, i.e. a 3D-printed ME phantom generated from patient image data. We show that our prototype provides > 74% visibility coverage of the sinus tympani, a region of the ME crucial for diagnosis, compared to an average of only 6.9% using a straight, non-articulated endoscope through the Eustachian Tube.

Human Kinematics of Cochlear Implant Surgery: An Investigation of Insertion Micro-Motions and Speed Limitations.

Objectives Document human motions associated with cochlear implant electrode insertion at different speeds and determine the lower limit of continuous insertion speed by a human. Study Design Observational. Setting Academic medical center. Subjects and Methods Cochlear implant forceps were coupled to a frame containing reflective fiducials, which enabled optical tracking of the forceps' tip position in real time. Otolaryngologists (n = 14) performed mock electrode insertions at different speeds based on recommendations from the literature: "fast" (96 mm/min), "stable" (as slow as possible without stopping), and "slow" (15 mm/min). For each insertion, the following metrics were calculated from the tracked position data: percentage of time at prescribed speed, percentage of time the surgeon stopped moving forward, and number of direction reversals (ie, going from forward to backward motion). Results Fast insertion trials resulted in better adherence to the prescribed speed (45.4% of the overall time), no motion interruptions, and no reversals, as compared with slow insertions (18.6% of time at prescribed speed, 15.7% stopped time, and an average of 18.6 reversals per trial). These differences were statistically significant for all metrics ( P < .01). The metrics for the fast and stable insertions were comparable; however, stable insertions were performed 44% slower on average. The mean stable insertion speed was 52 ± 19.3 mm/min. Conclusion Results indicate that continuous insertion of a cochlear implant electrode at 15 mm/min is not feasible for human operators. The lower limit of continuous forward insertion is 52 mm/min on average. Guidelines on manual insertion kinematics should consider this practical limit of human motion.

Pre-operative Screening and Manual Drilling Strategies to Reduce the Risk of Thermal Injury During Minimally Invasive Cochlear Implantation Surgery.

This article presents the development and experimental validation of a methodology to reduce the risk of thermal injury to the facial nerve during minimally invasive cochlear implantation surgery. The first step in this methodology is a pre-operative screening process, in which medical imaging is used to identify those patients that present a significant risk of developing high temperatures at the facial nerve during the drilling phase of the procedure. Such a risk is calculated based on the density of the bone along the drilling path and the thermal conductance between the drilling path and the nerve, and provides a criterion to exclude high-risk patients from receiving the minimally invasive procedure. The second component of the methodology is a drilling strategy for manually-guided drilling near the facial nerve. The strategy utilizes interval drilling and mechanical constraints to enable better control over the procedure and the resulting generation of heat. The approach is tested in fresh cadaver temporal bones using a thermal camera to monitor temperature near the facial nerve. Results indicate that pre-operative screening may successfully exclude high-risk patients and that the proposed drilling strategy enables safe drilling for low-to-moderate risk patients.

Safety margins in robotic bone milling: from registration uncertainty to statistically safe surgeries.

BACKGROUND: When robots mill bone near critical structures, safety margins are used to reduce the risk of accidental damage due to inaccurate registration. These margins are typically set heuristically with uniform thickness, which does not reflect the anisotropy and spatial variance of registration error. METHODS: A method is described to generate spatially varying safety margins around vital anatomy using statistical models of registration uncertainty. Numerical simulations are used to determine the margin geometry that matches a safety threshold specified by the surgeon. RESULTS: The algorithm was applied to CT scans of five temporal bones in the context of mastoidectomy, a common bone milling procedure in ear surgery that must approach vital nerves. Safety margins were generated that satisfied the specified safety levels in every case. CONCLUSIONS: Patient safety in image-guided surgery can be increased by incorporating statistical models of registration uncertainty in the generation of safety margins around vital anatomy.

Making Robots Mill Bone More Like Human Surgeons: Using Bone Density and Anatomic Information to Mill Safely and Efficiently.

Surgeons and robots typically use different approaches for bone milling. Surgeons adjust their speed and tool incidence angle constantly, which enables them to efficiently mill porous bone. Surgeons also adjust milling parameters such as speed and depth of cut throughout the procedure based on proximity to sensitive structures like nerves and blood vessels. In this paper we use image-based bone density estimates and segmentations of vital anatomy to make a robot mill more like a surgeon and less like an industrial computer numeric controlled (CNC) milling machine. We produce patient-specific plans optimizing velocity and incidence angles for spherical cutting burrs. These plans are particularly useful in bones of variable density and porosity like the human temporal bone. They result in fast milling in non-critical areas, reducing overall procedure time, and lower forces near vital anatomy. We experimentally demonstrate the algorithm on temporal bone phantoms and show that it reduces mean forces near vital anatomy by 63% and peak forces by 50% in comparison to a CNC-type path, without adding time to the procedure.

Online estimation of laser incision depth for transoral microsurgery: approach and preliminary evaluation.

BACKGROUND: The use of lasers in transoral surgery enables precise tissue incision with minimal adverse effects on surrounding structures. Nonetheless, the lack of haptic feedback during laser cutting impairs the surgeon's perception of the incision depth, potentially leading to undesired tissue damage. METHODS: This paper presents a novel approach, based on statistical regression analysis, to estimate the laser incision depth in soft tissue. User trials were conducted in a laser surgery set-up, to verify the effectiveness of online estimation of incision depth in supporting precise tissue cutting. RESULTS: The estimation accuracy was verified on ex vivo muscle tissue, revealing a root mean squared error (RMSE) of 0.1 mm for depths ranging up to 1.4 mm. Online estimation of depth has the potential to significantly improve the incision control of users. CONCLUSIONS: The proposed approach was successful in producing estimations of laser cutting depth in ex vivo muscle tissue. Further investigation is required to validate this approach on other types of tissue. Providing depth estimation during laser cutting allows users to perform more precise incisions.

Supervisory system for robot assisted laser phonomicrosurgery.

This paper presents the development of a system capable of generating safety alarms when unexpected or unforeseen situations are detected during larynx phonomicrosurgery. Such system establishes relations between the application of laser power and changes in laryngeal tissue characteristics and appearance. As core component, we propose a model able to map inputs generated by the surgeon when controlling the laser to an estimation of tissue temperature. Situations where this supervision is relevant have been identified.