Contactless, autonomous robotic alignment of optical coherence tomography for in vivo evaluation of diseased retinas.

During the COVID-19 pandemic, an emphasis was placed on contactless, physical distancing and improved telehealth; contrariwise, standard-of-care ophthalmic imaging of patients required present, trained personnel. Here, we introduce contactless, autonomous robotic alignment of optical coherence tomography (RAOCT) for in vivo imaging of retinal disease and compare measured retinal thickness and diagnostic readability to technician operated clinical OCT. In a powered study, we found no statistically significant difference in retinal thickness in both healthy and diseased retinas (p > 0.7) or across a variety of demographics (gender, race, and age) between RAOCT and clinical OCT. In a secondary study, a retina specialist labeled a given volume as normal/abnormal. Compared to the clinical diagnostic label, sensitivity/specificity for RAOCT were equal or improved over clinical OCT. Contactless, autonomous RAOCT, that improves upon current clinical OCT, could play a role in both ophthalmic care and non-ophthalmic settings that would benefit from improved eye care.

Robotic Optical Coherence Tomography Retinal Imaging for Emergency Department Patients: A Pilot Study for Emergency Physicians' Diagnostic Performance.

STUDY OBJECTIVE: To evaluate the diagnostic performance of emergency physicians' interpretation of robotically acquired retinal optical coherence tomography images for detecting posterior eye abnormalities in patients seen in the emergency department (ED). METHODS: Adult patients presenting to Duke University Hospital emergency department from November 2020 through October 2021 with acute visual changes, headache, or focal neurologic deficit(s) who received an ophthalmology consultation were enrolled in this pilot study. Emergency physicians provided standard clinical care, including direct ophthalmoscopy, at their discretion. Retinal optical coherence tomography images of these patients were obtained with a robotic, semi-autonomous optical coherence tomography system. We compared the detection of abnormalities in optical coherence tomography images by emergency physicians with a reference standard, a combination of ophthalmology consultation diagnosis and retina specialist optical coherence tomography review. RESULTS: Nine emergency physicians reviewed the optical coherence tomography images of 72 eyes from 38 patients. Based on the reference standard, 33 (46%) eyes were normal, 16 (22%) had at least 1 urgent/emergency abnormality, and the remaining 23 (32%) had at least 1 nonurgent abnormality. Emergency physicians' optical coherence tomography interpretation had 69% (95% confidence interval [CI], 49% to 89%) sensitivity for any abnormality, 100% (95% CI, 79% to 100%) sensitivity for urgent/emergency abnormalities, 48% (95% CI, 28% to 68%) sensitivity for nonurgent abnormalities, and 64% (95% CI, 44% to 84%) overall specificity. In contrast, emergency physicians providing standard clinical care did not detect any abnormality with direct ophthalmoscopy. CONCLUSION: Robotic, semi-autonomous optical coherence tomography enabled ocular imaging of emergency department patients with a broad range of posterior eye abnormalities. In addition, emergency provider optical coherence tomography interpretation was more sensitive than direct ophthalmoscopy for any abnormalities, urgent/emergency abnormalities, and nonurgent abnormalities in this pilot study with a small sample of patients and emergency physicians.

Optical coherence tomography refraction and optical path length correction for image-guided corneal surgery.

Optical coherence tomography (OCT) may be useful for guidance of ocular microsurgeries such as deep anterior lamellar keratoplasty (DALK), a form of corneal transplantation that requires delicate insertion of a needle into the stroma to approximately 90% of the corneal thickness. However, visualization of the true shape of the cornea and the surgical tool during surgery is impaired in raw OCT volumes due to both light refraction at the corneal boundaries, as well as geometrical optical path length distortion due to the group velocity of broadband OCT light in tissue. Therefore, uncorrected B-scans or volumes may not provide an accurate visualization suitable for reliable surgical guidance. In this article, we introduce a method to correct for both refraction and optical path length distortion in 3D in order to reconstruct corrected OCT B-scans in both natural corneas and corneas deformed by needle insertion. We delineate the separate roles of phase and group index in OCT image distortion correction, and introduce a method to estimate the phase index from the group index which is readily measured in samples. Using the measured group index and estimated phase index of human corneas at 1060 nm, we demonstrate quantitatively accurate geometric reconstructions of the true cornea and inserted needle shape during simulated DALK surgeries.

Data-Driven Modelling and Control for Robot Needle Insertion in Deep Anterior Lamellar Keratoplasty.

Deep anterior lamellar keratoplasty (DALK) is a technique for cornea transplantation which is associated with reduced patient morbidity. DALK has been explored as a potential application of robot microsurgery because the small scales, fine control requirements, and difficulty of visualization make it very challenging for human surgeons to perform. We address the problem of modelling the small scale interactions between the surgical tool and the cornea tissue to improve the accuracy of needle insertion, since accurate placement within 5% of target depth has been associated with more reliable clinical outcomes. We develop a data-driven autoregressive dynamic model of the tool-tissue interaction and a model predictive controller to guide robot needle insertion. In an ex vivo model, our controller significantly improves the accuracy of needle positioning by more than 40% compared to prior methods.

Contactless optical coherence tomography of the eyes of freestanding individuals with a robotic scanner.

Clinical systems for optical coherence tomography (OCT) are used routinely to diagnose and monitor patients with a range of ocular diseases. They are large tabletop instruments operated by trained staff, and require mechanical stabilization of the head of the patient for positioning and motion reduction. Here we report the development and performance of a robot-mounted OCT scanner for the autonomous contactless imaging, at safe distances, of the eyes of freestanding individuals without the need for operator intervention or head stabilization. The scanner uses robotic positioning to align itself with the eye to be imaged, as well as optical active scanning to locate the pupil and to attenuate physiological eye motion. We show that the scanner enables the acquisition of OCT volumetric datasets, comparable in quality to those of clinical tabletop systems, that resolve key anatomic structures relevant for the management of common eye conditions. Robotic OCT scanners may enable the diagnosis and monitoring of patients with eye conditions in non-specialist clinics.

Robotically aligned optical coherence tomography with 5 degree of freedom eye tracking for subject motion and gaze compensation.

Optical coherence tomography (OCT) has revolutionized diagnostics in ophthalmology. However, OCT requires a trained operator and patient cooperation to carefully align a scanner with the subject's eye and orient it in such a way that it images a desired region of interest at the retina. With the goal of automating this process of orienting and aligning the scanner, we developed a robot-mounted OCT scanner that automatically aligned with the pupil while matching its optical axis with the target region of interest at the retina. The system used two 3D cameras for face tracking and three high-resolution 2D cameras for pupil and gaze tracking. The tracking software identified 5 degrees of freedom for robot alignment and ray aiming through the ocular pupil: 3 degrees of translation (x, y, z) and 2 degrees of orientation (yaw, pitch). We evaluated the accuracy, precision, and range of our tracking system and demonstrated imaging performance on free-standing human subjects. Our results demonstrate that the system stabilized images and that the addition of gaze tracking and aiming allowed for region-of-interest specific alignment at any gaze orientation within a 28° range.

Optical Coherence Tomography-Guided Robotic Ophthalmic Microsurgery via Reinforcement Learning from Demonstration.

Ophthalmic microsurgery is technically difficult because the scale of required surgical tool manipulations challenge the limits of the surgeon's visual acuity, sensory perception, and physical dexterity. Intraoperative optical coherence tomography (OCT) imaging with micrometer-scale resolution is increasingly being used to monitor and provide enhanced real-time visualization of ophthalmic surgical maneuvers, but surgeons still face physical limitations when manipulating instruments inside the eye. Autonomously controlled robots are one avenue for overcoming these physical limitations. We demonstrate the feasibility of using learning from demonstration and reinforcement learning with an industrial robot to perform OCT-guided corneal needle insertions in an ex vivo model of deep anterior lamellar keratoplasty (DALK) surgery. Our reinforcement learning agent trained on ex vivo human corneas, then outperformed surgical fellows in reaching a target needle insertion depth in mock corneal surgery trials. This work shows the combination of learning from demonstration and reinforcement learning is a viable option for performing OCT guided robotic ophthalmic surgery.

Optical Coherence Tomography Guided Robotic Needle Insertion for Deep Anterior Lamellar Keratoplasty.

OBJECTIVE: Deep anterior lamellar keratoplasty (DALK) significantly reduces the post-transplantation morbidity in patients eligible for partial-thickness cornea grafts. The popular "big bubble" technique for DALK is so challenging, however, that a significant fraction of corneal pneumodissection attempts fail for surgeons without extensive DALK-specific experience, even with previous-generation cross-sectional optical coherence tomography (OCT) guidance. We seek to develop robotic, volumetric OCT-guided technology capable of facilitating or automating the difficult needle insertion step in DALK. METHODS: Our system provides for real-time volumetric corneal imaging, segmentation, and tracking of the needle insertion to display feedback for surgeons and to generate needle insertion plans for robotic execution. We include a non-automatic mode for cooperative needle control for stabilization and tremor attenuation, and an automatic mode in which needle insertion plans are generated based on OCT tracking results and executed under surgeon hold-to-run control by the robot arm. We evaluated and compared freehand, volumetric OCT-guided, cooperative, and automatic needle insertion approaches in terms of perforation rate and final needle depth in an ex vivo human cornea model. RESULTS: Volumetric OCT visualization reduces cornea perforations and beneficially increases final needle depth in manual insertions by clinically significant amounts. Our automatic robotic needle insertion techniques meet or exceed surgeon performance in both needle placement and perforation rate. CONCLUSION: Volumetric OCT is a key enabler for surgeons, although robotic techniques can reliably replicate their performance. SIGNIFICANCE: Robotic needle control and volumetric OCT promise to improve outcomes in DALK.

Real-time corneal segmentation and 3D needle tracking in intrasurgical OCT.

Ophthalmic procedures demand precise surgical instrument control in depth, yet standard operating microscopes supply limited depth perception. Current commercial microscope-integrated optical coherence tomography partially meets this need with manually-positioned cross-sectional images that offer qualitative estimates of depth. In this work, we present methods for automatic quantitative depth measurement using real-time, two-surface corneal segmentation and needle tracking in OCT volumes. We then demonstrate these methods for guidance of ex vivo deep anterior lamellar keratoplasty (DALK) needle insertions. Surgeons using the output of these methods improved their ability to reach a target depth, and decreased their incidence of corneal perforations, both with statistical significance. We believe these methods could increase the success rate of DALK and thereby improve patient outcomes.

Real-time visualization and interaction with static and live optical coherence tomography volumes in immersive virtual reality.

Virtual reality (VR) head-mounted displays are an attractive technology for viewing intrasurgical optical coherence tomography (OCT) volumes because they liberate surgeons from microscope oculars. We demonstrate real-time, interactive viewing of OCT volumes in a commercial HTC Vive immersive VR system using previously reported ray casting techniques. Furthermore, we show interactive manipulation and sectioning of volumes using handheld controllers and guidance of mock surgical procedures in porcine eyes exclusively within VR. To the best of our knowledge, we report the first immersive VR-OCT viewer with stereo ray casting volumetric renders, arbitrary sectioning planes, and live acquisition support. We believe VR-OCT volume displays will advance ophthalmic surgery towards VR-integrated surgery.

Review of intraoperative optical coherence tomography: technology and applications [Invited].

During microsurgery, en face imaging of the surgical field through the operating microscope limits the surgeon's depth perception and visualization of instruments and sub-surface anatomy. Surgical procedures outside microsurgery, such as breast tumor resections, may also benefit from visualization of the sub-surface tissue structures. The widespread clinical adoption of optical coherence tomography (OCT) in ophthalmology and its growing prominence in other fields, such as cancer imaging, has motivated the development of intraoperative OCT for real-time tomographic visualization of surgical interventions. This article reviews key technological developments in intraoperative OCT and their applications in human surgery. We focus on handheld OCT probes, microscope-integrated OCT systems, and OCT-guided laser treatment platforms designed for intraoperative use. Moreover, we discuss intraoperative OCT adjuncts and processing techniques currently under development to optimize the surgical feedback derivable from OCT data. Lastly, we survey salient clinical studies of intraoperative OCT for human surgery.