OCT-based intra-cochlear imaging and 3D reconstruction: ex vivo validation of a robotic platform.

PURPOSE: The small size of the cochlea, and its location deeply embedded in thick temporal bone, poses a challenge for intra-cochlear guidance and diagnostics. Current radiological imaging techniques are not able to visualize the cochlear microstructures in detail. Rotational optical coherence tomography (OCT) fibers show great potential for intra-cochlear guidance. The generated images could be used to map, and study, the tiny cochlear microstructures relevant for hearing. METHODS: This work describes the design of a rotational OCT probe with an outer diameter of 0.9 mm. It further discusses a robotic system, which features a remote center of motion mechanism, dedicated to the probe's positioning, fine manipulation and stable insertion into the cochlear micro-spaces. Furthermore, the necessary calibration steps for 3D reconstruction are described, followed by a detailed quantitative analysis, comparing the 3D reconstructions using a synthetic, 2:1 scaled scala tympani model with a reconstruction from micro-CT, serving as the ground truth. Finally, the potential of the system is demonstrated by scanning a single ex vivo cadaveric human cochlea. RESULTS: The study investigates five insertions in the same 2:1 scaled tympani model, along with their corresponding 3D reconstruction. The comparison with micro-CT results in an average root-mean-square error of 74.2 µm, a signed distance error of 38.1 µm and a standard deviation of 63.6 µm. The average F-score of the reconstructions, using a distance threshold of 100 and 74.2 µm, resulted in 83.0% and 71.8%, respectively. Insertion in the cadaveric human cochlea showed the challenges for straight insertion, i.e., navigating the hook region. CONCLUSION: Overall, the system shows great potential for intra-cochlear guidance and diagnostics, due to the system's capability for precise and stable insertion into the basal turn in the scala tympani. The system, combined with the calibration procedure, results in detailed and precise 3D reconstructions.

Comparative Analysis of Interactive Modalities for Intuitive Endovascular Interventions.

Endovascular intervention is a minimally invasive method for treating cardiovascular diseases. Although fluoroscopy, known for real-time catheter visualization, is commonly used, it exposes patients and physicians to ionizing radiation and lacks depth perception due to its 2D nature. To address these limitations, a study was conducted using teleoperation and 3D visualization techniques. This in-vitro study involved the use of a robotic catheter system and aimed to evaluate user performance through both subjective and objective measures. The focus was on determining the most effective modes of interaction. Three interactive modes for guiding robotic catheters were compared in the study: 1) Mode GM, using a gamepad for control and a standard 2D monitor for visual feedback; 2) Mode GH, with a gamepad for control and HoloLens providing 3D visualization; and 3) Mode HH, where HoloLens serves as both control input and visualization device. Mode GH outperformed other modalities in subjective metrics, except for mental demand. It exhibited a median tracking error of 4.72 mm, a median targeting error of 1.01 mm, a median duration of 82.34 s, and a median natural logarithm of dimensionless squared jerk of 40.38 in the in-vitro study. Mode GH showed 8.5%, 4.7%, 6.5%, and 3.9% improvements over Mode GM and 1.5%, 33.6%, 34.9%, and 8.1% over Mode HH for tracking error, targeting error, duration, and dimensionless squared jerk, respectively. To sum up, the user study emphasizes the potential benefits of employing HoloLens for enhanced 3D visualization in catheterization. The user study also illustrates the advantages of using a gamepad for catheter teleoperation, including user-friendliness and passive haptic feedback, compared to HoloLens. To further gauge the potential of using a more traditional joystick as a control input device, an additional study utilizing the Haption VirtuoseTM robot was conducted. It reveals the potential for achieving smoother trajectories, with a 38.9% reduction in total path length compared to a gamepad, potentially due to its larger range of motion and single-handed control.

Development and validation of a flexible fetoscope for fetoscopic laser coagulation.

PURPOSE: Fetoscopic laser coagulation for twin-to-twin transfusion syndrome is challenging for anterior placenta due to the rigidity of current tools. The capacity to keep entry port forces minimal is critical for this procedure, as is optimal coagulation distance and orientation. This work introduces technological tools to this end. METHODS: A novel fetoscope is presented with a rigid shaft and a flexible steerable segment at the distal end. The steerable segment can bend up to 90[Formula: see text] even when loaded with a laser fiber. An artificial pneumatic muscle makes such acute bending possible while allowing for a low-weight and disposable device. RESULTS: The flexible fetoscope was validated in a custom-made phantom model to measure visual range and coagulation efficacy. The flexible fetoscope shows promising results when compared to a clinical rigid curved fetoscope to reach anterior targets. The new fetoscope was then evaluated in vivo (pregnant ewe) where it successfully coagulated placental vasculature. CONCLUSION: The flexible fetoscope improved the ability to achieve optimal coagulation angle and distance on anteriorly located targets. The fetoscope also showed the potential to lead fetoscopic laser coagulation and other fetal surgical procedures toward safer and more effective interventions.

Robot-assisted ultrasound reconstruction for spine surgery: from bench-top to pre-clinical study.

PURPOSE: Robot-assisted ultrasound (rUS) systems have already been used to provide non-radiative three-dimensional (3D) reconstructions that form the basis for guiding spine surgical procedures. Despite promising studies on this technology, there are few studies that offer insight into the robustness and generality of the approach by verifying performance in various testing scenarios. Therefore, this study aims at providing an assessment of a rUS system, with technical details from experiments starting at the bench-top to the pre-clinical study. METHODS: A semi-automatic control strategy was proposed to ensure continuous and smooth robotic scanning. Next, a U-Net-based segmentation approach was developed to automatically process the anatomic features and derive a high-quality 3D US reconstruction. Experiments were conducted on synthetic phantoms and human cadavers to validate the proposed approach. RESULTS: Average deviations of scanning force were found to be 2.84±0.45 N on synthetic phantoms and to be 5.64±1.10 N on human cadavers. The anatomic features could be reliably reconstructed at mean accuracy of 1.28±0.87 mm for the synthetic phantoms and of 1.74±0.89 mm for the human cadavers. CONCLUSION: The results and experiments demonstrate the feasibility of the proposed system in a pre-clinical setting. This work is complementary to previous work, encouraging further exploration of the potential of this technology in in vivo studies.

Motion and viewing analysis during minimally invasive surgery for autostereoscopic visualization.

PURPOSE: Autostereoscopic 3D visualization (ASV) forms a potentially appealing alternative to stereoscopic 3D displays to help surgeons regain depth perception during minimally invasive surgery (MIS). However, the feasibility of using single-viewer ASV has not yet been demonstrated in a clinical context. The purpose of the study is to analyze the current surgical workflow and display usage and assess the potential for using ASV in MIS applications. Additionally, the study seeks to acquire a better understanding of key design requirements, such as the eye-tracking performance and the lenticular lens 3D workspace. METHODS: Two types of gynecologic interventions were investigated. A vision-based tracking system was developed, consisting of depth cameras mounted on the displays and ArUco markers placed on the hair caps of clinicians and the wall of the operating room. This allowed simultaneous tracking of the pose of operating staff and displays. RESULTS: Overall 20 surgeries were recorded, where 4 clinicians operated using 3 displays. Users were typically standing at a mean distance of 1900 mm in a range from to 1200 to 2300 mm from the display. Left-right motion was from - 600 to 658 mm. Clinicians stood on average 1000 mm from each other. The head roll angle was below 16[Formula: see text]. CONCLUSION: Surgeons were looking predominantly (99%) to the same display. Observations took place from fairly well-defined places and with sufficient potential to differentiate between clinicians, suggesting that single-viewer ASV would be feasible.

A Novel Method for Surface Exploration by 6-DOF Encountered-Type Haptic Display Towards Virtual Palpation.

Surface exploration in virtual reality has a large potential to enrich the user's experience. It could for example be used to train and simulate medical palpation. During palpation, users tap, indent, and rub the surface of a sample to estimate the underlying properties. However, up to now there is no good approach to render such intricate interaction realistically. This paper introduces 6 degrees of freedom (DoF) encountered-type haptic display technology for simulating surface exploration tasks. Among the different phases of exploration, this article focuses on the 'in-contact sliding' phase. Two novel control approaches to render sliding over a virtual surface are elaborated. A first rendering method generates lateral frictional forces as the finger slides over the surface. A second method adjusts the inclination of the end-effector to render tissue properties. With both methods a stiff nodule embedded in a soft tissue was prepared. User experiments were carried out to find proper parameter and intensity ranges and to confirm the feasibility of the new rendering schemes. Participants indicated that both rendering schemes felt realistic. Compared to earlier work, where only the vertical stiffness was altered, lower thresholds to detect and localise embedded virtual nodules were found. Users also made fewer errors in detecting nodule edges. Furthermore, the method that used end-effector inclination allowed faster discovery of the nodule's edges. It is expected that approaches that combine both rendering methods could provide an even more realistic feel.

From a Disposable Ureteroscope to an Active Lightweight Fetoscope-Characterization and Usability Evaluation.

The twin-to-twin transfusion syndrome is a severe fetal anomaly appearing in up to 15% of identical twin pregnancies. This anomaly occurs when twins share blood vessels from a common placenta. The complication leads to an unbalanced blood transfusion between both fetuses. A current surgical treatment consists in coagulating the shared vessels using a fetoscope with an embedded laser. Such treatment is very delicate and constraining due to limited vision and size of the insertion area. The rigidity and lack of controllability of the current used instruments add an additional difficulty and limit the choice in insertion site. This letter proposes an improved flexible fetoscope, offering an enhanced laser controllability and higher versatility regarding the location of the insertion site. A better approach angle can therefore be realized. Also, tissue damage may be further reduced. This single-handed controllable active fetoscope is obtained after adaptation of a LithoVue (Boston Scientific, Natick, MA, USA), a commercially available passive flexible ureteroscope. The LithoVue is fitted with a unique lightweight add-on actuation module foreseen of an artificial muscle and a dedicated control system. Experiments in a mixed reality trainer suggested that the proposed fetoscope is compact, ergonomic, and intuitive in use, allowing an adequate control of the flexible end.

Control of a hybrid robotic system for computer-assisted interventions in dynamic environments.

PURPOSE: Minimally invasive surgery is becoming the standard treatment of care for a variety of procedures. Surgeons need to display a high level of proficiency to overcome the challenges imposed by the minimal access. Especially when operating on a dynamic organ, it becomes very difficult to align instruments reliably and precisely. In this paper, a hybrid rigid/continuum robotic system and a dedicated robotic control approach are proposed to assist the surgeon performing complex surgical gestures in a dynamic environment. METHODS: The proposed robotic system consists of a rigid robot arm on top of which a continuum robot is mounted in series. The continuum robot is locally actuated with McKibben muscles. A control scheme based on quadratic programming framework is adopted. It is shown that the framework allows enforcing a set of constraints on the pose of the tip, as well as of the instrument shaft, which is commanded to slide in and out through the entry point. RESULTS: Through simulation and experiments, it is shown how the robot tool tip is able to follow sinusoidal trajectories of 0.37 and 2 Hz, while maintaining the instrument shaft pivoting along the entry point. The positioning and tracking accuracy of such system are shown to lie below 4.7 mm in position and [Formula: see text] in angle. CONCLUSION: The results suggest a good potential for applying the proposed technology to assist the surgeon during complex robot-assisted interventions. It is also illustrated that even when using flexible hence relatively safe end-effectors, it is possible to reach acceptable tracking behaviour at relatively high frequencies.

Estimation of optimal pivot point for remote center of motion alignment in surgery.

PURPOSE: The determination of an optimal pivot point ([Formula: see text]) is important for instrument manipulation in minimally invasive surgery. Such knowledge is of particular importance for robotic-assisted surgery where robots need to rotate precisely around a specific point in space in order to minimize trauma to the body wall while maintaining position control. Remote center of motion (RCM) mechanisms are commonly used, where the RCM point is manually and visually aligned. If not positioned appropriately, this misalignment might lead to intolerably high forces on the body wall with increased risk of postoperative complications or instrument damage. An automated method to align the RCM with the [Formula: see text] was developed and tested. METHOD: Computer vision and a lightweight calibration procedure are used to estimate the optimal pivot point. One or two pre-calibrated cameras viewing the surgical scene are employed. The surgeon is asked to make short pivoting movements, applying as little torque as possible, with an instrument of choice passing through the insertion point while camera images are being recorded. The physical properties of an instrument rotating around a pivot point are exploited in a random sample consensus scheme to robustly estimate the ideal position of the RCM in the image planes. Triangulation is used to estimate the RCM position in 3D. Experiments were performed on a specially designed mockup to test the method. RESULTS: The position of the pivot point is estimated with an average error less than 1.85 mm using two webcams placed from approximately 30 cm to 1 m away from the scene. The entire procedure was completed in a few seconds. CONCLUSION: In automated method to estimate the ideal position of the RCM was shown to be reliable. The method can be implemented within a visual servoing approach to automatically place the RCM point, or the results can be displayed on a screen to provide guidance to the surgeon. Further work includes the development of an image-guided alignment method and validation with in vivo experiments.