Continuum Robots for Medical Interventions.

Continuum robots are not constructed with discrete joints but, instead, change shape and position their tip by flexing along their entire length. Their narrow curvilinear shape makes them well suited to passing through body lumens, natural orifices, or small surgical incisions to perform minimally invasive procedures. Modeling and controlling these robots are, however, substantially more complex than traditional robots comprised of rigid links connected by discrete joints. Furthermore, there are many approaches to achieving robot flexure. Each presents its own design and modeling challenges, and to date, each has been pursued largely independently of the others. This article attempts to provide a unified summary of the state of the art of continuum robot architectures with respect to design for specific clinical applications. It also describes a unifying framework for modeling and controlling these systems while additionally explaining the elements unique to each architecture. The major research accomplishments are described for each topic and directions for the future progress needed to achieve widespread clinical use are identified.

A Multi-Modal Sensor Array for Human-Robot Interaction and Confined Spaces Exploration Using Continuum Robots.

Safe human-robot interaction requires robots endowed with perception. This paper presents the design of a multi-modal sensory array for continuum robots, targeting operation in semi-structured confined spaces with human users. Active safety measures are enabled via sensory arrays capable of simultaneous sensing of proximity, contact, and force. Proximity sensing is achieved using time-of-flight sensors, while contact force is sensed using Hall effect sensors and embedded magnets. The paper presents the design and fabrication of these sensors, the communication protocol and multiplexing scheme used to allow an interactive rate of communication with a high-level controller, and an evaluation of these sensors for actively mapping the shape of the environment and compliance control using gestures and contact with the robot. Characterization of the proximity sensors is presented with considerations of sensitivity to lighting, color, and texture conditions. Also, characterization of the force sensing is presented. The results show that the multi-modal sensory array can enable pre and post-collision active safety measures and can also enable user interaction with the robot. We believe this new technology allows for increased safety for human-robot interaction in confined and semi-structures spaces due to its demonstrated capabilities of detecting impending collision and mapping the environment along the length of the robot. Future miniaturization of the electronics will also allow possible integration in smaller continuum and soft robots.

Investigation of Micro-motion Kinematics of Continuum Robots for Volumetric OCT and OCT-guided Visual Servoing.

Continuum robots (CR) have been recently shown capable of micron-scale motion resolutions. Such motions are achieved through equilibrium modulation using indirect actuation for altering either internal preload forces or changing the cross-sectional stiffness along the length of a continuum robot. Previously reported, but unexplained, turning point behavior is modeled using two approaches. An energy minimization approach is first used to explain the source of this behavior. Subsequently, a kinematic model using internal constraints in multi-backbone CRs is used to replicate this turning point behavior. An approach for modeling the micro-motion differential kinematics is presented using experimental data based on the solution of a system of linear matrix equations. This approach provides a closed-form approximation of the empirical micro-motion kinematics and could be easily used for real-time control. A motivating application of image-based biopsy using 3D optical coherence tomography (OCT) is envisioned and demonstrated in this paper. A system integration for generating OCT volumes by sweeping a custom B-mode OCT probe is presented. Results showing high accuracy in obtaining 3D OCT measurements are shown using a commercial OCT probe. Qualitative results using a miniature probe integrated within the robot are also shown. Finally, closed-loop visual servoing using OCT data is demonstrated for guiding a needle into an agar channel. Results of this paper present what we believe is the first embodiment of a continuum robot capable of micro and macro motion control for 3D OCT imaging. This approach can support the development of new technologies for CRs capable of surgical intervention and micro-motion for ultra-precision tasks.

Sensitivity Ellipsoids for Force Control of Magnetic Robots with Localization Uncertainty.

The navigation of magnetic medical robots typically relies on localizing an actuated, intracorporeal, ferromagnetic body and back-computing a necessary field and gradient that would result in a desired wrench on the device. Uncertainty in this localization degrades the precision of force transmission. Reducing applied force uncertainty may enhance tasks such as in-vivo navigation of miniature robots, actuation of magnetically guided catheters, tissue palpation, as well as simply ensuring a bound on forces applied on sensitive tissue. In this paper, we analyzed the effects of localization noise on force uncertainty by using sensitivity ellipsoids of the magnetic force Jacobian and introduced an algorithm for uncertainty reduction. We validated the algorithm in both a simulation study and in a physical experiment. In simulation, we observed reductions in estimated force uncertainty by factors of up to 2.8 and 3.1 when using one and two actuating magnets, respectively. On a physical platform, we demonstrated a force uncertainty reduction by a factor of up to 2.5 as measured using an external sensor. Being the first consideration of force uncertainty resulting from noisy localization, this work provides a strategy for investigators to minimize uncertainty in magnetic force transmission.

Jacobian-Based Iterative Method for Magnetic Localization in Robotic Capsule Endoscopy.

The purpose of this study is to validate a Jacobian-based iterative method for real-time localization of magnetically controlled endoscopic capsules. The proposed approach applies finite-element solutions to the magnetic field problem and least-squares interpolations to obtain closed-form and fast estimates of the magnetic field. By defining a closed-form expression for the Jacobian of the magnetic field relative to changes in the capsule pose, we are able to obtain an iterative localization at a faster computational time when compared with prior works, without suffering from the inaccuracies stemming from dipole assumptions. This new algorithm can be used in conjunction with an absolute localization technique that provides initialization values at a slower refresh rate. The proposed approach was assessed via simulation and experimental trials, adopting a wireless capsule equipped with a permanent magnet, six magnetic field sensors, and an inertial measurement unit. The overall refresh rate, including sensor data acquisition and wireless communication was 7 ms, thus enabling closed-loop control strategies for magnetic manipulation running faster than 100 Hz. The average localization error, expressed in cylindrical coordinates was below 7 mm in both the radial and axial components and 5° in the azimuthal component. The average error for the capsule orientation angles, obtained by fusing gyroscope and inclinometer measurements, was below 5°.

Future robotic platforms in urologic surgery: recent developments.

PURPOSE OF REVIEW: To review recent developments at Vanderbilt University of new robotic technologies and platforms designed for minimally invasive urologic surgery and their design rationale and potential roles in advancing current urologic surgical practice. RECENT FINDINGS: Emerging robotic platforms are being developed to improve performance of a wider variety of urologic interventions beyond the standard minimally invasive robotic urologic surgeries conducted currently with the da Vinci platform. These newer platforms are designed to incorporate significant advantages of robotics to improve the safety and outcomes of transurethral bladder surgery and surveillance, further decrease the invasiveness of interventions by advancing LESS surgery, and to allow for previously impossible needle access and ablation delivery. SUMMARY: Three new robotic surgical technologies that have been developed at Vanderbilt University are reviewed, including a robotic transurethral system to enhance bladder surveillance and transurethral bladder tumor, a purpose-specific robotic system for LESS, and a needle-sized robot that can be used as either a steerable needle or small surgeon-controlled micro-laparoscopic manipulator.

Five degrees-of-freedom mechanical arm with remote center of motion (RCM) device for volumetric optical coherence tomography (OCT) retinal imaging.

Handheld optical coherence tomography (HH-OCT) is gaining popularity for diagnosing retinal diseases in neonates (e.g. retinopathy of prematurity). Diagnosis accuracy is degraded by hand tremor and patient motion when using commercially available handheld retinal OCT probes. This work presents a low-cost arm designed to address ergonomic challenges of holding a commercial OCT probe and alleviating hand tremor. Experiments with a phantom eye show enhanced geometric uniformity and volumetric accuracy when obtaining OCT scans with our device compared to handheld imaging approaches. An in-vivo porcine volumetric image was also obtained with the mechanical arm demonstrating clinical deployability.

Endovascular Detection of Catheter-Thrombus Contact by Vacuum Excitation.

OBJECTIVE: The objective of this work is to introduce and demonstrate the effectiveness of a novel sensing modality for contact detection between an off-the-shelf aspiration catheter and a thrombus. METHODS: A custom robotic actuator with a pressure sensor was used to generate an oscillatory vacuum excitation and sense the pressure inside the extracorporeal portion of the catheter. Vacuum pressure profiles and robotic motion data were used to train a support vector machine (SVM) classification model to detect contact between the aspiration catheter tip and a mock thrombus. Validation consisted of benchtop accuracy verification, as well as user study comparison to the current standard of angiographic presentation. RESULTS: Benchtop accuracy of the sensing modality was shown to be 99.67%. The user study demonstrated statistically significant improvement in identifying catheter-thrombus contact compared to the current standard. The odds ratio of successful detection of clot contact was 2.86 (p = 0.03) when using the proposed sensory method compared to without it. CONCLUSION: The results of this work indicate that the proposed sensing modality can offer intraoperative feedback to interventionalists that can improve their ability to detect contact between the distal tip of a catheter and a thrombus. SIGNIFICANCE: By offering a relatively low-cost technology that affords off-the-shelf aspiration catheters as clot-detecting sensors, interventionalists can improve the first-pass effect of the mechanical thrombectomy procedure while reducing procedural times and mental burden.

Design and Coordination Kinematics of an Insertable Robotic Effectors Platform for Single-Port Access Surgery.

Single port access surgery (SPAS) presents surgeons with added challenges that require new surgical tools and surgical assistance systems with unique capabilities. To address these challenges, we designed and constructed a new insertable robotic end-effectors platform (IREP) for SPAS. The IREP can be inserted through a Ø15 mm trocar into the abdomen and it uses 21 actuated joints for controlling two dexterous arms and a stereo-vision module. Each dexterous arm has a hybrid mechanical architecture comprised of a two-segment continuum robot, a parallelogram mechanism for improved dual-arm triangulation, and a distal wrist for improved dexterity during suturing. The IREP is unique because of the combination of continuum arms with active and passive segments with rigid parallel kinematics mechanisms. This paper presents the clinical motivation, design considerations, kinematics, statics, and mechanical design of the IREP. The kinematics of coordination between the parallelogram mechanisms and the continuum arms is presented using the pseudo-rigid-body model of the beam representing the passive segment of each snake arm. Kinematic and static simulations and preliminary experiment results are presented in support of our design choices.

Automated Recognition of Robotic Manipulation Failures in High-throughput Biodosimetry Tool.

A completely automated, high-throughput biodosimetry workstation has been developed by the Center for Minimally Invasive Radiation Biodosimetry at Columbia University over the past few years. To process patients' blood samples safely and reliably presents a significant challenge in the development of this biodosimetry tool. In this paper, automated failure recognition methods of robotic manipulation of capillary tubes based on a torque/force sensor are described. The characteristic features of sampled raw signals are extracted through data preprocessing. The twelve-dimensional (12D) feature space is projected onto a two-dimensional (2D) feature plane by the optimized Principal Component Analysis (PCA) and Fisher Discrimination Analysis (FDA) feature extraction functions. For the three-class manipulation failure problem in the cell harvesting module, FDA yields better separability index than that of PCA and produces well separated classes. Three classification methods, Support Vector Machine (SVM), Fisher Linear Discrimination (FLD) and Quadratic Discrimination Analysis (QDA), are employed for real-time recognition. Considering the trade-off between error rate and computation cost, SVM achieves the best overall performance.

A Review of Robotic and OCT-Aided Systems for Vitreoretinal Surgery.

The introduction of the intraocular vitrectomy instrument by Machemer et al. has led to remarkable advancements in vitreoretinal surgery enabling the limitations of human physiologic capabilities to be reached. To overcome the barriers of perception, tremor, and dexterity, robotic technologies have been investigated with current advancements nearing the feasibility for clinical use. There are four categories of robotic systems that have emerged through the research: (1) handheld instruments with intrinsic robotic assistance, (2) hand-on-hand robotic systems, (3) teleoperated robotic systems, and (4) magnetic guidance robots. This review covers the improvements and the remaining needs for safe, cost-effective clinical deployment of robotic systems in vitreoretinal surgery.

Modal-Based Kinematics and Contact Detection of Soft Robots.

Soft robots offer an alternative approach to manipulate within a constrained space while maintaining a safe interaction with the external environment. Owing to its adaptable compliance characteristic, external contact force can easily deform the robot shapes and lead to undesired robot kinematic and dynamic properties. Accurate contact detection and contact location estimation are of critical importance for soft robot modeling, control, trajectory planning, and eventually affect the success of task completion. In this article, we focus on the investigation of a one degree of freedom (1-DoF) soft pneumatic bending robot, which is regarded as one of the fundamental components to construct complex, multi-DoFs soft robots. This 1-DoF soft robot is modeled through the integral representation of the spatial curve, where direct and instantaneous kinematics are calculated explicitly through a modal method. The fixed centrode deviation method is used to detect the external contact and estimate the contact location. Simulation results and experimental studies indicate that the contact location can be accurately estimated by solving a nonlinear least-square optimization problem. Experimental validation shows that the proposed algorithm is able to successfully estimate the contact location with the estimation error of 1.46 mm.

A decade retrospective of medical robotics research from 2010 to 2020.

Robotics is a forward-looking discipline. Attention is focused on identifying the next grand challenges. In an applied field such as medical robotics, however, it is important to plan the future based on a clear understanding of what the research community has recently accomplished and where this work stands with respect to clinical needs and commercialization. This Review article identifies and analyzes the eight key research themes in medical robotics over the past decade. These thematic areas were identified using search criteria that identified the most highly cited papers of the decade. Our goal for this Review article is to provide an accessible way for readers to quickly appreciate some of the most exciting accomplishments in medical robotics over the past decade; for this reason, we have focused only on a small number of seminal papers in each thematic area. We hope that this article serves to foster an entrepreneurial spirit in researchers to reduce the widening gap between research and translation.

Design and Integration of a Telerobotic System for Minimally Invasive Surgery of the Throat.

This paper presents the clinical motivation, design specifications, kinematics, statics, and actuation compensation for a newly constructed telerobotic system for Minimally Invasive Surgery (MIS) of the throat. A hybrid dual-arm telesurgical slave, with twenty joint-space Degrees of Freedom (DoF), is used in this telerobotic system to provide the necessary dexterity in deep surgical fields such as the throat. The telerobotic slave uses novel continuum robots that use multiple super-elastic backbones for actuation and structural integrity. The paper presents the kinematics of the telesurgical slave and methods for actuation compensation to cancel the effects of backlash, friction, and flexibility of the actuation lines. A method for actuation compensation is presented in order to overcome uncertainties of modeling, friction, and backlash. This method uses a tiered hierarchy of two novel approaches of actuation compensation for remotely actuated snake-like robots. The tiered approach for actuation compensation uses compensation in both joint space and configuration space of the continuum robots. These actuation hybrid compensation schemes use intrinsic model information and external data through a recursive linear estimation algorithm and involve compensation using configuration space and joint space variables. Experimental results validate the ability of our integrated telemanipulation system through experiments of suturing and knot tying in confined spaces.

Investigating variability in cochlear implant electrode array alignment and the potential of visualization guidance.

Background Internal cochlear anatomy is difficult to discern from external inspection, hindering cochlear implant electrode insertion. Methods A user study characterized the repeatability of standard surgical technique and examined the role of visual inspection and guidance cues in reducing electrode array insertion misalignment. Results Without guidance, a large spread in angles of insertion, up to 30°, was observed, highlighting the need for intraoperative guidance. Visual inspection did not significantly improve overall orientation, suggesting the need for alternate intracochlear visualization methods and/or increased training to effectively improve surgeon understanding of the visualized images. Visual cues and guidance software increased repeatability of surgeon performance, reducing one metric of repeatability to ±2°. Conclusions This study establishes a baseline for surgeon variability in cochlear implant insertion and supports the need and lays the groundwork for future intraoperative guidance techniques.

Sensorless Estimation of the Planar Distal Shape of a Tip-Actuated Endoscope.

Traditional endoscopes consist of a flexible body and a steerable tip with therapeutic capability. Although prior endoscopes have relied on operator pushing for actuation, recent robotic concepts have relied on the application of a tip force for guidance. In such case, the body of the endoscope can be passive and compliant; however, the body can have significant effect on mechanics of motion and may require modeling. As the endoscope body's shape is often unknown, we have developed an estimation method to recover the approximate distal shape, local to the endoscope's tip, where the tip position and orientation are the only sensed parameters in the system. We leverage a planar dynamic model and extended Kalman filter to obtain a constant-curvature shape estimate of a magnetically guided endoscope. We validated this estimator in both dynamic simulations and on a physical platform. We then used this estimate in a feed-forward control scheme and demonstrated improved trajectory following. This methodology can enable the use of inverse-dynamic control for the tip-based actuation of an endoscope, without the need for shape sensing.

Applications of robotics for laryngeal surgery.

The authors present the clinical application of robotics to laryngeal surgery in terms of enhancement of surgical precision and performance of other minimally invasive procedures not feasible with current instrumentation. Presented in this article are comparisons of human arm with robotic arm in terms of degrees of freedom and discussion of surgeries and outcomes with use of the robotic arm. Robotic equipment for laryngeal surgery has the potential to overcome many of the limitations of endolaryngeal procedures by improving optics, increasing instrument degrees of freedom, and modulating tremor. Outside of laryngology, a multi-armed robotic system would have utility in microvascular surgery, procedures at the base of the skull, sinus surgery, and single-port gastrointestinal and thoracic access surgery.

Dual-Continuum Design Approach for Intuitive and Low-Cost Upper Gastrointestinal Endoscopy.

OBJECTIVE: This paper introduces a methodology to design intuitive, low-cost, and portable devices for visual inspection of the upper gastrointestinal tract. METHODS: The proposed approach mechanically couples a multi-backbone continuum structure, as the user interface, and a parallel bellows actuator, as the endoscopic tip. Analytical modeling techniques derived from continuum robotics were adopted to describe the endoscopic tip motion from user input, accounting for variations in component size and pneumatic compressibility. The modeling framework was used to improve intuitiveness of user-to-task mapping. This was assessed against a 1:1 target, while ease-of-use was validated using landmark identification tasks performed in a stomach simulator by one expert and ten non-expert users; benchmarked against conventional flexible endoscopy. Pre-clinical validation consisted of comparative trials in in-vivo porcine and human cadaver models. RESULTS: Target mapping was achieved with an average error of 5° in bending angle. Simulated endoscopies were performed by an expert user successfully, within a time comparable to conventional endoscopy (<1 minute difference). Non-experts using the proposed device achieved visualization of the stomach in a shorter time (9s faster on average) than with a conventional endoscope. The estimated cost is <10 USD and <30 USD for disposable and reusable parts, respectively. Significance and Conclusions: Flexible endoscopes are complex and expensive devices, actuated via non-intuitive cable-driven mechanisms. They frequently break, requiring costly repair, and necessitate a dedicated reprocessing facility to prevent cross contamination. The proposed solution is portable, inexpensive, and easy to use, thus lending itself to disposable use by personnel without formal training in flexible endoscopy.

Preliminary Porcine In Vivo Evaluation of a Telerobotic System for Transurethral Bladder Tumor Resection and Surveillance.

INTRODUCTION: Transurethral resection of bladder tumors (TURBTs) can be a challenging procedure, primarily due to limitations in tooltip dexterity, visualization, and lack of tissue depth information. A transurethral robotic system was developed to revolutionize TURBTs by addressing some of these limitations. The results of three pilot in vivo porcine studies using the novel robotic system are presented and potential improvements are proposed based on experimental observations. MATERIALS AND METHODS: A transvesical endoscope with a mounted optically tracked camera was placed through the bladder of the swine under general anesthesia. Simulated bladder lesions were created by injecting HistoGel processing gel mixed with blue dye, transabdominally, into various locations in the bladder wall under endoscopic visualization. A 7-degree-of-freedom (DoF) robot was then used for transurethral resection/ablation of these simulated tumors. An independent 2-DoF distal laser arm (DLA) was deployed through the robot for laser ablation and was assisted by a manually controlled gripper for en bloc resection attempts. RESULTS: Lesions were created and ablated using our novel endoscopic robot in the swine bladder. Full accessibility of the bladder, including the bladder neck and dome, was demonstrated without requiring bladder deflation or pubic compression. Simulated lesions were ablated using the holmium laser. En bloc resection was demonstrated using the DLA and a manual grasper. CONCLUSION: Feasibility of robot-assisted en bloc resection was demonstrated. Main challenges were lack of depth perception and visual occlusion induced by the transvesical endoscope. Recommendations are given to enhance robot-assisted TURBTs. Lessons learned through these pilot swine studies verify the feasibility of robot-assisted TURBTs while informing designers about critical aspects needed for future clinical deployment.

Detection of modiolar proximity through bipolar impedance measurements.

OBJECTIVES: To test the hypothesis that bipolar electrical impedance measurements in perimodiolar cochlear implants (CIs) may be used to differentiate between perimodiolar insertion technique favoring proximity to the modiolus or lateral wall. STUDY DESIGN AND METHODS: Bipolar impedances are a measure of electrical resistance between pairs of electrode contacts in a CI. Stimulation is through biphasic pulses at fixed frequency. Impedance measurements were made in real time through sequential sampling of electrode pairs. Perimodiolar electrodes were inserted in temporal bones using one of two techniques: 1) In the standard insertion technique (SIT), the electrode array slides along the lateral wall during insertion. 2) In the Advance Off Stylet (Cochlear Ltd. Sydney) technique (AOS), the electrode maintains modiolar contact throughout the insertion process. A set of 22 insertions were performed in temporal bone specimens using perimodiolar electrode arrays with both AOS and SIT. Buffered saline was used as a substitute for natural perilymph based on similar electrical conductivity properties. Impedance with and without stylet removal were recorded with a 30-second sampling window at final insertion depth. RESULTS: There is a significant difference in bipolar impedance measures between AOS and SIT, with impedances rising in measurements with stylet removal. Evaluation was based on two-sided analysis of variance considering technique and electrode with P < 0.025. CONCLUSION: Bipolar electrical impedance can be used to detect relative motion toward the modiolus inside the cochlea. This detection method has the potential to optimize intraoperative placement of perimodiolar electrode arrays during implantation. We anticipate that this will result in lower excitation thresholds and improved hearing outcome. LEVEL OF EVIDENCE: NA. Laryngoscope, 127:1413-1419, 2017.