Force-based control strategy for a collaborative robotic camera holder in laparoscopic surgery using pivoting motion.

Introduction: Laparoscopic surgery often relies on a fixed Remote Center of Motion (RCM) for robot mobility control, which assumes that the patient's abdominal walls are immobile. However, this assumption is inaccurate, especially in collaborative surgical environments. In this paper, we present a force-based strategy for the mobility of a robotic camera-holder system for laparoscopic surgery based on a pivoting motion. This strategy re-conceptualizes the conventional mobility control paradigm of surgical robotics. Methods: The proposed strategy involves direct control of the Tool Center Point's (TCP) position and orientation without any constraints associated with the spatial position of the incision. It is based on pivoting motions to minimize contact forces between the abdominal walls and the laparoscope. The control directly relates the measured force and angular velocity of the laparoscope, resulting in the reallocation of the trocar, whose position becomes a consequence of the natural accommodation allowed by this pivoting. Results: The effectiveness and safety of the proposed control were evaluated through a series of experiments. The experiments showed that the control was able to minimize an external force of 9 N to ±0.2 N in 0.7 s and reduce it to 2 N in just 0.3 s. Furthermore, the camera was able to track a region of interest by displacing the TCP as desired, leveraging the strategy's property that dynamically constrains its orientation. Discussion: The proposed control strategy has proven to be effective minimizing the risk caused by sudden high forces resulting from accidents and maintaining the field of view despite any movements in the surgical environment, such as physiological movements of the patient or undesired movements of other surgical instruments. This control strategy can be implemented for laparoscopic robots without mechanical RCMs, as well as commercial collaborative robots, thereby improving the safety of surgical interventions in collaborative environments.

Collaborative Robotic Assistant Platform for Endonasal Surgery: Preliminary In-Vitro Trials.

Endonasal surgery is a minimally invasive approach for the removal of pituitary tumors (sarcomas). In this type of procedure, the surgeon has to complete the surgical maneuvers for sarcoma resection with extreme precision, as there are many vital structures in this area. Therefore, the use of robots for this type of intervention could increase the success of the intervention by providing accurate movements. Research has focused on the development of teleoperated robots to handle a surgical instrument, including the use of virtual fixtures to delimit the working area. This paper aims to go a step further with a platform that includes a teleoperated robot and an autonomous robot dedicated to secondary tasks. In this way, the aim is to reduce the surgeon's workload so that he can concentrate on his main task. Thus, the article focuses on the description and implementation of a navigator that coordinates both robots via a force/position control. Finally, both the navigation and control scheme were validated by in-vitro tests.

Automatic gauze tracking in laparoscopic surgery using image texture analysis.

BACKGROUND AND OBJECTIVE: Inadvertent retained surgical gauzes are an infrequent medical error but can have devastating consequences in the patient health and in the surgeon professional reputation. This problem seems easily preventable implementing standardized protocols for counting but due to human errors it still persists in surgery. The omnipresence of gauzes, their small size, and their similar appearance with tissues when they are soaked in blood make this error eradication really complex. In order to reduce the risk of accidental retention of surgical sponges in laparoscopy operations, in this paper we present an image processing system that tracks the gauzes on the video captured by the endoscope. METHODS: The proposed image processing application detects the presence of gauzes in the video images using texture analysis techniques. The process starts dividing the video frames into square blocks and each of these blocks is analyzed to determine whether it is similar to the gauze pattern. The video processing algorithm has been tested in a laparoscopic simulator under different conditions: with clean, slightly stained and soaked in blood gauzes as well as against different biological background tissues. Several methods, including different Local Binary Patterns (LBP) techniques and a convolutional neural network (CNN), have been analyzed in order to achieve a reliable detection in real time. RESULTS: The proposed LBP algorithm classifies the individual blocks in the image with 98% precision and 94% sensitivity which is sufficient to make a robust detection of any gauze that appears in the endoscopic video even if it is stained or soaked in blood. The results provided by the CNN are superior with 100% precision and 97% sensitivity, but due to the high computational demand, real-time video processing is not attainable in this case with standard hardware. CONCLUSIONS: The algorithm presented in this paper is a valuable tool to avoid the retention of surgical gauzes not only because of its reliability but also because it processes the video transparently and unattended, without the need for additional manipulation of special equipment in the operating room.

Using "human state aware" robots to enhance physical human-robot interaction in a cooperative scenario.

Human motor performance, speed and variability are highly susceptible to emotional states. This paper reviews the impact of the emotions on the motor control performance, and studies the possibility of improving the perceived skill/challenge relation on a multimodal neural rehabilitation scenario, by means of a biocybernetic controller that modulates the assistance provided by a haptic controlled robot in reaction to undesirable physical and mental states. Results from psychophysiological, performance and self assessment data for closed loop experiments in contrast with their open loop counterparts, suggest that the proposed method had a positive impact on the overall challenge/skill relation leading to an enhanced physical human-robot interaction experience.