Semi-Automated Extraction of Lens Fragments via a Surgical Robot Using Semantic Segmentation of OCT Images with Deep Learning - Experimental Results in ex vivo Animal Model.

The overarching goal of this work is to demonstrate the feasibility of using optical coherence tomography (OCT) to guide a robotic system to extract lens fragments from ex vivo pig eyes. A convolutional neural network (CNN) was developed to semantically segment four intraocular structures (lens material, capsule, cornea, and iris) from OCT images. The neural network was trained on images from ten pig eyes, validated on images from eight different eyes, and tested on images from another ten eyes. This segmentation algorithm was incorporated into the Intraocular Robotic Interventional Surgical System (IRISS) to realize semi-automated detection and extraction of lens material. To demonstrate the system, the semi-automated detection and extraction task was performed on seven separate ex vivo pig eyes. The developed neural network exhibited 78.20% for the validation set and 83.89% for the test set in mean intersection over union metrics. Successful implementation and efficacy of the developed method were confirmed by comparing the preoperative and postoperative OCT volume scans from the seven experiments.

Robotic posterior capsule polishing by optical coherence tomography image guidance.

BACKGROUND: In cataract surgery, polishing of the posterior capsule (PC) can lead to improved surgical outcomes but is currently avoided due to its high-risk nature. This work developed a robotic system capable of performing PC polishing on ex vivo pig eyes using optical coherence tomography (OCT) guidance. METHODS: The lenses of five ex vivo pig eyes were extracted and a thin layer of glue deposited onto the PC. Transpupillary OCT scans of the anterior segment were used to generate a PC-polishing trajectory. During polishing, OCT B-scans tracked the tool tip and were displayed to the operator. RESULTS: Complete removal of the glue was accomplished in all five trials with no PC rupture reported. CONCLUSIONS: The feasibility of using a robotic system guided by OCT to perform PC polishing on a biological model was demonstrated. Contributions include modelling of the PC anatomy, intraoperative OCT visualization, and automated tool-tip motion with scheduled aspiration pressures.

Automated Retinal Vein Cannulation on Silicone Phantoms Using Optical-Coherence-Tomography-Guided Robotic Manipulations.

Retinal vein occlusion is one of the most common causes of vision loss, occurring when a blood clot or other obstruction occludes a retinal vein. A potential remedy for retinal vein occlusion is retinal vein cannulation, a surgical procedure that involves infusing the occluded vein with a fibrinolytic drug to restore blood flow through the vascular lumen. This work presents an image-guided robotic system capable of performing automated cannulation on silicone retinal vein phantoms. The system is integrated with an optical coherence tomography probe and camera to provide visual feedback to guide the robotic system. Through automation, the developed system targets a vein phantom to within 20 µm and automatically cannulates and infuses the vascular lumen with dyed water. The system was evaluated through 30 experimental trials and shown to be capable of performing automated cannulation of retinal vein phantoms with no reported cases of failure.

Advanced robotic surgical systems in ophthalmology.

In this paper, an overview of advanced robotic surgical systems in ophthalmology is provided. The systems are introduced as representative examples of the degree of human vs. robotic control during surgical procedures. The details are presented on each system and the latest advancements of each are described. Future potential applications for surgical robotics in ophthalmology are discussed in detail, with representative examples provided alongside recent progress.

A robotic system for telementoring and training in laparoscopic surgery.

A laparoscopic surgical training system, the LapaRobot, is introduced. The system is composed of an expert station and a trainee station connected through the Internet. Embedded actuators allow the trainee station to be driven by an expert surgeon so that a trainee learns proper technique through physical feedback. The surgical-tool trajectory and video feed can be recorded and later "played back" to a trainee to hone operative skills through guided repetition without the need for expert supervision. The system is designed to create a high-fidelity approximation of the intracorporeal workspace, incorporate commercially available surgical instruments, and provide a wealth of high-resolution data for quantitative analysis and feedback. Experimental evaluation demonstrated a 55% improvement in surgical performance with use of our system. In this paper, we introduce the details of the design and fabrication of the LapaRobot, illustrate the mechatronics and software-control schemes, and evaluate the system in a study.

Semiautomated optical coherence tomography-guided robotic surgery for porcine lens removal.

PURPOSE: To evaluate semiautomated surgical lens extraction procedures using the optical coherence tomography (OCT)-integrated Intraocular Robotic Interventional Surgical System. SETTING: Stein Eye Institute and Department of Mechanical and Aerospace Engineering, University of California, Los Angeles, USA. DESIGN: Experimental study. METHODS: Semiautomated lens extraction was performed on postmortem pig eyes using a robotic platform integrated with an OCT imaging system. Lens extraction was performed using a series of automated steps including robot-to-eye alignment, irrigation/aspiration (I/A) handpiece insertion, anatomic modeling, surgical path planning, and I/A handpiece navigation. Intraoperative surgical supervision and human intervention were enabled by real-time OCT image feedback to the surgeon via a graphical user interface. Manual preparation of the pig-eye models, including the corneal incision and capsulorhexis, was performed by a trained cataract surgeon before the semiautomated lens extraction procedures. A scoring system was used to assess surgical complications in a postoperative evaluation. RESULTS: Complete lens extraction was achieved in 25 of 30 eyes. In the remaining 5 eyes, small lens pieces (≤1.0 mm3) were detected near the lens equator, where transpupillary OCT could not image. No posterior capsule rupture or corneal leakage occurred. The mean surgical duration was 277 seconds ± 42 (SD). Based on a 3-point scale (0 = no damage), damage to the iris was 0.33 ± 0.20, damage to the cornea was 1.47 ± 0.20 (due to tissue dehydration), and stress at the incision was 0.97 ± 0.11. CONCLUSIONS: No posterior capsule rupture was reported. Complete lens removal was achieved in 25 trials without significant surgical complications. Refinements to the procedures are required before fully automated lens extraction can be realized.

Intraocular robotic interventional surgical system (IRISS): Semi-automated OCT-guided cataract removal.

BACKGROUND: With the development of laser-assisted platforms, the outcomes of cataract surgery have been improved by automating several procedures. The cataract-extraction step continues to be manually performed, but due to deficiencies in sensing capabilities, surgical complications such as posterior capsule rupture and incomplete cataract removal remain. METHODS: An optical coherence tomography (OCT) system is integrated into our intraocular robotic interventional surgical system (IRISS) robot. The OCT images are used for preoperative planning and intraoperative intervention in a series of automated procedures. Real-time intervention allows surgeons to evaluate the progress and override the operation. RESULTS: The developed system was validated by performing lens extraction on 30 postmortem pig eyes. Complete lens extraction was achieved on 25 eyes, and "almost complete" extraction was achieved on the remainder due to an inability to image small lens particles behind the iris. No capsule rupture was found. CONCLUSION: The IRISS successfully demonstrated semiautomated OCT-guided lens removal with real-time supervision and intervention.

Intraocular robotic interventional surgical system (IRISS): Mechanical design, evaluation, and master-slave manipulation.

BACKGROUND: Since the advent of robotic-assisted surgery, the value of using robotic systems to assist in surgical procedures has been repeatedly demonstrated. However, existing technologies are unable to perform complete, multi-step procedures from start to finish. Many intraocular surgical steps continue to be manually performed. METHODS: An intraocular robotic interventional surgical system (IRISS) capable of performing various intraocular surgical procedures was designed, fabricated, and evaluated. Methods were developed to evaluate the performance of the remote centers of motion (RCMs) using a stereo-camera setup and to assess the accuracy and precision of positioning the tool tip using an optical coherence tomography (OCT) system. RESULTS: The IRISS can simultaneously manipulate multiple surgical instruments, change between mounted tools using an onboard tool-change mechanism, and visualize the otherwise invisible RCMs to facilitate alignment of the RCM to the surgical incision. The accuracy of positioning the tool tip was measured to be 0.205±0.003 mm. The IRISS was evaluated by trained surgeons in a remote surgical theatre using post-mortem pig eyes and shown to be effective in completing many key steps in a variety of intraocular surgical procedures as well as being capable of performing an entire cataract extraction from start to finish. CONCLUSIONS: The IRISS represents a necessary step towards fully automated intraocular surgery and demonstrated accurate and precise master-slave manipulation for cataract removal and-through visual feedback-retinal vein cannulation.

Tractional Abnormalities of the Central Foveal Bouquet in Epiretinal Membranes: Clinical Spectrum and Pathophysiological Perspectives.

PURPOSE: To investigate the tractional alterations of the central bouquet (CB) in idiopathic epiretinal membranes (ERMs). DESIGN: Retrospective, consecutive, observational case series. METHODS: ERMs were classified according to a 4-stage grading system. The CB was defined as a circular area of approximately 100 µm composed of densely packed cones (and Müller cells) in the central fovea. Tractional abnormalities of the CB were identified with spectral-domain optical coherence tomography. Ex vivo histopathologic analysis was performed. RESULTS: In this study 263 eyes with ERMs were included. Mean follow-up was 21.2 ± 16.7 months. At baseline, tractional abnormalities of the CB were diagnosed in 58 out of 263 eyes (22%) and divided into 3 categories: cotton ball sign (defined as a fuzzy hyperreflective area between the ellipsoid zone and the interdigitation zone in the central fovea), foveolar detachment, and acquired vitelliform lesion. The presence of ectopic inner foveal layers was negatively correlated with the presence of CB tractional abnormalities (P = .002). Visual acuity was highest in association with the cotton ball sign and lowest in the acquired vitelliform lesion group. Sequential morphologic progression was identified in 7 eyes. Ex vivo histopathologic analysis illustrated characteristic staining patterns supporting a potential mechanism of traction by Müller cells in the CB. CONCLUSIONS: The cotton ball sign, foveolar detachment, and acquired vitelliform lesion may comprise a continuum in the same clinical spectrum and may represent subsequent stages of CB abnormalities. Foveal Müller cells may play an integral role in the transmission of mechanical forces to the central foveal cones.