Effects of a force feedback function in a surgical robot on the suturing procedure.

BACKGROUND: Currently, widely used robotic surgical systems do not provide force feedback. This study aimed to evaluate the impact and benefits of a force feedback function on the suturing procedure. METHODS: Twenty surgeons were recruited and divided into young (Y-group, n = 11) and senior (S-group, n = 9) groups, based on their years of surgical experience. The effect of the force feedback function on suturing quality was evaluated using an objective assessment system (A-LAP mini, Kyoto Kagaku Co., Ltd., Kyoto, Japan). Each participant completed the suturing task on intestinal model sheets with the robotic contact force feedback on and off. The task accomplishment time (s), maximal force (Newton, N) applied to the robotic forceps, and quality of suturing (assessed by A-LAP mini) were recorded as performance parameters. RESULTS: In total, the maximal force applied to the robotic forceps was significantly decreased with the robotic force feedback switched on (median [interquartile range]: 2.8 N (2.3-3.2)) as compared with when the feedback was switched off (3.4 N (2.7-4.0), P < 0.001). The contact force feedback function did not affect the objectively assessed suturing score (18 points (17.7-19.0) versus 18 points (17.0-19.0), P = 0.421). The contact force feedback function slightly shortened the task accomplishment time in the Y-group (552.5 s (466.5-832) versus 605.5 s (476.2-689.7), P = 0.851) but not in the S-group (566 s (440.2-703.5) versus 470.5 s (419.7-560.2), P = 0.164). CONCLUSIONS: With the contact force feedback function, the suturing task was completed with a smaller maximal force, while maintaining the quality of suturing. Because the benefits are more apparent in young surgeons, robots with the contact force feedback function will facilitate the educational process in novice surgeons.

Field experiment of a telesurgery system using a surgical robot with haptic feedback.

PURPOSE: To verify the usefulness of haptic feedback in telesurgery and improve the safety of telerobotic surgery. METHODS: The surgeon's console was installed at two sites (Fukuoka and Beppu; 140 km apart), and the patient cart was installed in Fukuoka. During the experiment, the surgeon was blinded to the haptic feedback levels and asked to grasp the intestinal tract in an animal model. The surgeon then performed the tasks at each location. RESULTS: No marked differences in task accuracy or average grasping force were observed between the surgeon locations. However, the average task completion time was significantly longer, and the system usability scale (SUS) was significantly lower rating for remote operations than for local ones. No marked differences in task accuracy or task completion time were observed between the haptic feedback levels. However, with haptic feedback, the organ was grasped with a significantly weaker force than that without it. Furthermore, with haptic feedback, experienced surgeons in robotic surgery tended to perform an equivalent task with weaker grasping forces than inexperienced surgeons. CONCLUSION: The haptic feedback function is a tool that allows the surgeon to perform surgery with an appropriate grasping force, both on site and remotely. Improved safety is necessary in telesurgery; haptic feedback will thus be an essential technology in robotic telesurgery going forward.

Telesurgery and telesurgical support using a double-surgeon cockpit system allowing manipulation from two locations.

BACKGROUND: Although several studies on telesurgery have been reported globally, a clinically applicable technique has not yet been developed. As part of a telesurgical study series conducted by the Japan Surgical Society, this study describes the first application of a double-surgeon cockpit system to telesurgery. METHODS: Surgeon cockpits were installed at a local site and a remote site 140 km away. Three healthy pigs weighing between 26 and 29 kg were selected for surgery. Non-specialized surgeons performed emergency hemostasis, cholecystectomy, and renal vein ligation with remote assistance using the double-surgeon cockpits and specialized surgeons performed actual telesurgery. Additionally, the impact of adding internet protocol security (IPsec) encryption to the internet protocol-virtual private network (IP-VPN) line on communication was evaluated to address clinical security concerns. RESULTS: The average time required for remote emergency hemostasis with the double-surgeon cockpit system was 10.64 s. A non-specialized surgeon could safely perform cholecystectomy or renal vein ligation with remote assistance. Global Evaluative Assessment of Robotic Skills and System Usability Scale scores were higher for telesurgical support-assisted surgery by a non-specialized surgeon using the double-surgeon cockpits than for telesurgery performed by a specialized surgeon without the double-cockpit system. Adding IPsec encryption to the IP-VPN did not have a significant impact on communication. CONCLUSION: Telesurgical support through our double-surgeon cockpit system is feasible as first step toward clinical telesurgery.

Real-time telementoring with 3D drawing annotation in robotic surgery.

BACKGROUND: In telementoring, differences in teaching methods affect local surgeons' comprehension. Because the object to be operated on is a three-dimensional (3D) structure, voice or 2D annotation may not be sufficient to convey the instructor's intention. In this study, we examined the usefulness of telementoring using 3D drawing annotations in robotic surgery. METHODS: Kyushu University and Beppu Hospital are located 140 km apart, and the study was conducted using a Saroa™ surgical robot by RIVERFIELD Inc. using a commercial guarantee network on optical fiber. Twenty medical students performed vertical mattress suturing using a swine intestinal tract under surgical guidance at the Center for Advanced Medical Innovation Kyushu University. Surgical guidance was provided by Beppu Hospital using voice, 2D, and 3D drawing annotations. All robot operations were performed using 3D images, and only the annotations were independently switched between voice and 2D and 3D images. The operation time, needle movement, and performance were also evaluated. RESULTS: The 3D annotation group tended to have a shorter working time than the control group (25.6 ± 63.2 vs. - 36.7 ± 65.4 min, P = 0.06). The 3D annotation group had fewer retries than the control group (1.3 ± 1.7 vs. - 1.1 ± 0.7, P = 0.006), and there was a tendency for fewer needle drops (0.4 ± 0.7 vs. - 0.5 ± 0.9, P = 0.06). The 3D annotation group scored significantly higher than the control group on the Global Evaluate Assessment of Robot Skills (16.8 ± 2.0 vs. 22.8 ± 2.4, P = 0.04). The 3D annotation group also scored higher than the voice (13.4 ± 1.2) and 2D annotation (16.2 ± 1.8) groups (3D vs. voice: P = 0.03, 3D vs. 2D: P = 0.03). CONCLUSION: Telementoring using 3D drawing annotation was shown to provide good comprehension and a smooth operation for local surgeons.

Development of a Wearable Haptic Glove Presenting Haptic Sensation by Electrical Stimulation.

Most haptic devices generate haptic sensation using mechanical actuators. However, the workload and limited workspace handicap the operator from operating freely. Electrical stimulation is an alternative approach to generate haptic sensations without using mechanical actuators. The light weight of the electrodes adhering to the body brings no limitations to free motion. Because a real haptic sensation consists of feelings from several areas, mounting the electrodes to several different body areas can make the sensations more realistic. However, simultaneously stimulating multiple electrodes may result in "noise" sensations. Moreover, the operators may feel tingling because of unstable stimulus signals when using the dry electrodes to help develop an easily mounted haptic device using electrical stimulation. In this study, we first determine the appropriate stimulation areas and stimulus signals to generate a real touch sensation on the forearm. Then, we propose a circuit design guideline for generating stable electrical stimulus signals using a voltage divider resistor. Finally, based on the aforementioned results, we develop a wearable haptic glove prototype. This haptic glove allows the user to experience the haptic sensations of touching objects with five different degrees of stiffness.

Ensuring communication redundancy and establishing a telementoring system for robotic telesurgery using multiple communication lines.

Assuring communication redundancy during the interruption and establishing appropriate teaching environments for local surgeons are essential to making robotic telesurgery mainstream. This study analyzes robotic telesurgery with telementoring using standard domestic telecommunication carriers. Can multiple carriers guarantee redundancy with interruptions? Three commercial optical fiber lines connected Hirosaki University and Mutsu General Hospitals, 150 km apart. Using Riverfield, Inc. equipment, Hirosaki had a cockpit, while both Mutsu used both a cockpit and a surgeon's console. Experts provided telementoring evaluating 14 trainees, using objective indices for operation time and errors. Subjective questionnaires addressed image quality and surgical operability. Eighteen participants performed telesurgery using combined lines from two/three telecommunication carriers. Manipulation: over 30 min, lines were cut and restored every three minutes per task. Subjects were to press a switch when noticing image quality or operability changes. Mean time to task completion was 1510 (1186-1960) seconds: local surgeons alone and 1600 (1152-2296) seconds for those under remote instructor supervision, including expert intervention time. There was no significant difference (p = 0.86). The mean error count was 0.92 (0-3) for local surgeons and 0.42 (0-2) with remote instructors. Image quality and operability questionnaires found no significant differences. Results communication companies A, B, and C: the A/B combination incurred 0.17 (0-1) presses of the environment change switch, B/C had 0, and C/A received 0.67 (0-3), showing no significant difference among provider combinations. Combining multiple communication lines guarantees communication redundancy and enables robotic telementoring with enhanced communication security.

Real-time fundus reconstruction and intraocular mapping using an ophthalmic endoscope.

BACKGROUND: Robotic ophthalmic endoscope holders allow surgeons to execute dual-hand operations in eye surgery. To prevent needle-like endoscopes from invading the retina when moving, surgeons expect visual and real-time information about the relative special relationship between the endoscope and fundus. METHODS: This study develops a real-time fundus reconstruction method. First, using deep learning, the method estimates the distance between the fundus part corresponding to every pixel of the RGB endoscopic image and the endoscope. Then, by combining the estimated distance with the kinematics of a robotic holder, the point cloud representing the present fundus area is generated, and by which the size and position of the eyeball are estimated. RESULTS: This method shows a real-time frequency of 10 Hz, which is robust to eyeball movement. The error of fundus reconstruction is about 0.5 mm, and the error of eyeball estimation is about 1 mm. CONCLUSION: Using this fundus reconstruction method can map the position of the endoscope inside the eyeball when using a robotic endoscope holder in eye surgery. The overall accuracy level meets the ophthalmologists' accuracy requirements of ophthalmologists.

Construction of redundant communications to enhance safety against communication interruptions during robotic remote surgery.

It is important to ensure the redundancy of communication during remote surgery. The purpose of this study is to construct a communication system that does not affect the operation in the event of a communication failure during telesurgery. The hospitals were connected by two commercial lines, a main line and a backup line, with redundant encoder interfaces. The fiber optic network was constructed using both guaranteed and best-effort lines. The surgical robot used was from Riverfield Inc. During the observation, a random shutdown and restoration process of either line was conducted repeatedly. First, the effects of communication interruption were investigated. Next, we performed a surgical task using an artificial organ model. Finally, 12 experienced surgeons performed operations on actual pigs. Most of the surgeons did not feel the effects of the line interruption and restoration on still and moving images, in artificial organ tasks, and in pig surgery. During all 16 surgeries, a total of 175-line switches were performed, and 15 abnormalities were detected by the surgeons. However, there were no abnormalities that coincided with the line switching. It was possible to construct a system in which communication interruptions would not affect the surgery.

Leader manipulator with hand rest function for microsurgery.

BACKGROUND: Hand rest assists microsurgeons with maintaining a stable hand condition. In manipulating a surgical robot using teleoperation, the external hand rest poses mechanical difficulties such as interferences from manipulators. METHODS: Herein, we introduced hand rest functionality into a leader manipulator. The hand rest function was realised by switching the impedance value in admittance control for the translation section. With teleoperation, we evaluated the positioning accuracy in the direction of gravity and the manipulating conditions during precise positioning. RESULTS: The experiments proved that the position of the hand rest could be arranged at the intended position, and the condition with the hand rest function, applying sufficiently high impedance, and not constraining the hand rest completely provided the best performance. CONCLUSION: Our leader manipulator showed the potentials to improve the quality of robotic microsurgery with the advantage in fine manipulation based on large repositionable working range of the hand rest.

Eye Explorer: A robotic endoscope holder for eye surgery.

BACKGROUND: Holding endoscopes by hand when performing eye surgery reduces the dexterity of the surgeon. METHODS: A robotic endoscope holder called "Eye Explorer" is proposed to hold the endoscope and free the surgeon's hand. RESULTS: This device satisfies the engineering and clinical requirements of eye surgery. The force for manual operation is less than 0.5 N. The observable ranges inside the patient's eye considering horizontal and vertical perspectives are 118° and 97°, and the motion of the holder does not interfere with the surgeon's hand and other surgical devices. The self-weight compensation can prevent the endoscope from falling when extra supporting force is released. When comparing the external force exerted on the eye by the Eye Explorer with that in case of manual operation, a decrease of more than 15% can be observed. Moreover, the consumption time of endoscope view adjustment using the Eye Explorer and manual operation does not significantly differ. CONCLUSION: The Eye Explorer allows dual-hand operation, facilitating a successful endoscopic eye surgery.

Manipulation of a master manipulator with a combined-grip-handle of pinch and power grips.

Conventional robotic surgery employs pinch and power grips for manipulating a master manipulator. As such, the manipulating methods exhibit limitations that are strongly related to the advantages and disadvantages of the gripping type. The context of this paper is focused on the introduction of a combined grip to compensate for such restraints. In particular, this paper proposed the combined-grip-handle scheme on a master manipulator, which employs both the pinch and power grips. A pointing experiment applying the master-slave scheme was conducted with the master manipulator under several manipulating conditions of the combined grip and the conventional gripping types. Results of using the combined grip demonstrated that the positioning operation performed with fewer failures and required shorter time and trajectory. Compared with the conventional gripping types, the proposed combined grip showed better performance on the positioning operation and provided a possibility to perform precise work at lower scale factors.

Robots in laparoscopic surgery: current and future status.

In this paper, we focus on robots used for laparoscopic surgery, which is one of the most active areas for research and development of surgical robots. We introduce research and development of laparoscope-holder robots, master-slave robots and hand-held robotic forceps. Then, we discuss future directions for surgical robots. For robot hardware, snake like flexible mechanisms for single-port access surgery (SPA) and NOTES (Natural Orifice Transluminal Endoscopic Surgery) and applications of soft robotics are actively used. On the software side, research such as automation of surgical procedures using machine learning is one of the hot topics.

A pneumatic laparoscope holder controlled by head movement.

BACKGROUND: In traditional laparoscopic surgery, the laparoscope is handled by a camera assistant according to verbal instructions from the surgeon. Thus there is a strong need for a laparoscope holder who intuitively provides the appropriate view with excellent stability. METHODS: A pneumatically driven robotic arm was developed to hold and manipulate a laparoscope. The robotic arm is operated by the user's head movement, which is measured with gyroscopes attached to the operator's head and body. RESULTS: We confirmed experimentally that head tracking can be performed accurately using the proposed method. The experimental results indicated that the robotic camera holder has sufficient dynamic characteristics to quickly follow the operator's head movement. CONCLUSIONS: A laparoscope holder control system has been developed. In this system, a laparoscope is held by a pneumatically driven robotic arm that is controlled to follow the operator's head movement. The experimental results prove the effectiveness of the system. Copyright © 2014 John Wiley & Sons, Ltd.

Surgical energy device using steam jet for robotic assisted surgery.

In robotic assisted surgery, the carbonization and the adherence of coagulated tissues caused by surgical energy devices are problems. We propose a surgical energy device using a steam jet to solve the problems. The device applies a steam jet and performs coagulation and hemostasis. The exposed tissue is heated quickly with latent heat of the steam. The carbonization and the adherence of the tissue can be avoided. We prototyped a steam jet coagulator to prove the concept. The coagulator was mounted on the laparoscopic surgical robot. The effectiveness of the coagulation and hemostasis using steam was confirmed by the in vitro experiment on the chicken's liver and the in vivo experiments on the pig's spleen under the robotic assisted laparoscopic environment.

Plugfest 2009: Global Interoperability in Telerobotics and Telemedicine.

Despite the great diversity of teleoperator designs and applications, their underlying control systems have many similarities. These similarities can be exploited to enable inter-operability between heterogeneous systems. We have developed a network data specification, the Interoperable Telerobotics Protocol, that can be used for Internet based control of a wide range of teleoperators. In this work we test interoperable telerobotics on the global Internet, focusing on the telesurgery application domain. Fourteen globally dispersed telerobotic master and slave systems were connected in thirty trials in one twenty four hour period. Users performed common manipulation tasks to demonstrate effective master-slave operation. With twenty eight (93%) successful, unique connections the results show a high potential for standardizing telerobotic operation. Furthermore, new paradigms for telesurgical operation and training are presented, including a networked surgery trainer and upper-limb exoskeleton control of micro-manipulators.