Design and Research of the Grasping Force Feedback Mechanism of Flexible Surgical Robots.

BACKGROUND: Robot-assisted microsurgery (RAMS) is gradually becoming the preferred method for some delicate surgical procedures. However, the lack of haptic feedback reduces the safety of the surgery. Surgeons are unable to feel the grasping force between surgical instruments and the patient's tissues, which can easily lead to grasping failure or tissue damage. METHODS: This paper proposes a tendon-driven grasping force feedback mechanism, consisting of a follower hand and a leader hand, to address the lack of grasping force feedback in flexible surgical robots. Considering the friction in the tendon transmission process, a grasping force estimation model is established for the follower hand. The admittance control model is designed for force/position control of the leader hand. RESULTS: Through experimental validation, it has been confirmed that the grasping force sensing range of the follower hand is 0.5-5 N, with a sensing accuracy of 0.3 N. The leader hand is capable of providing feedback forces in the range of 0-5 N, with a static force accuracy of 0.1 N. CONCLUSIONS: The designed mechanism and control strategy can provide the grasping force feedback function. Future work will focus on improving force feedback performance. TRIAL REGISTRATION: This research has no clinical trials.

Simulation-based Flexible Needle Control with Single-core FBG Feedback for Spinal Injections.

Objective: We present a general framework of simultaneous needle shape reconstruction and control input generation for robot-assisted spinal injection procedures, without continuous imaging feedback. Methods: System input-output mapping is generated with a real-time needle-tissue interaction simulation, and single-core FBG sensor readings are used as local needle shape feedback within the same simulation framework. FBG wavelength shifts due to temperature variation is removed by exploiting redundancy in fiber arrangement. Results: Targeting experiments performed on both plastisol lumbar phantoms as well as an ex vivo porcine lumbar section achieved in-plane tip errors of 0.6 ± 0.3 mm and 1.6 ± 0.9 mm , and total tip errors of 0.9 ± 0.7 mm and 2.1 ± 0.8 mm for the two testing environments. Significance: Our clinically inspired control strategy and workflow is self-contained and not dependent on the modality of imaging guidance. The generalizability of the proposed approach can be applied to other needle-based interventions where medical imaging cannot be reliably utilized as part of a closed-loop control system for needle guidance.

Evaluation of Clinical Research on Novel Multiport Robotic Platforms for Urological Surgery According to the IDEAL Framework: A Systematic Review of the Literature.

Background and objective: Several novel multiport robotic systems have been developed and introduced in clinical practice after regulatory approval. The objective of this systematic review was to assess the evolution status of novel robotic platforms approved for clinical use in urological surgery according to the IDEAL framework. Methods: A systematic review was conducted using the Medline and Scopus databases according to the updated Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines (CRD42024503227). Comparative or noncomparative studies reporting on any urological procedures performed with novel robotic platforms (Hugo RAS; Versius, KangDuo, Senhance, REVO-I, Avatera, Hinotori, Dexter, or Toumai) were selected and included in the analysis. Key findings and limitations: Seventy-four eligible studies were included, of which 67 (90.5%) were noncomparative surgical series representing developmental or explorative studies according to the IDEAL criteria. Only one randomised controlled trial (comparing KangDuo vs da Vinci robot-assisted partial nephrectomy) was included. The trial showed comparable perioperative outcomes between the two robotic systems. Four studies assessed clinical outcomes for patients undergoing urological procedures using a REVO-I (1 study), Senhance (2 studies), or Hinotori (1 study) system in comparison to the same procedures performed using a da Vinci system. All studies revealed outcomes comparable to those with the da Vinci system. Limitations include the small sample size in all studies, and assessment of first-generation novel platforms versus the fourth-generation multiarm da Vinci system in most of the comparative studies. Conclusions and clinical implications: A few poor-quality studies have compared the use of novel robotic platforms to da Vinci systems in urological surgery and demonstrated comparable results. Most studies can be classified as developmental or explorative, representing the initial steps of clinical research. Large multicentre series are needed to understand whether these novel robots could offer advantages beyond cost reductions over the da Vinci systems. Patient summary: We reviewed research on new robotic systems for surgery in urology. Several studies have shown the feasibility and safety of these new robots during the most common procedures. Very few studies have assessed clinical outcomes with the new robots in comparison to the reference standard, which is a fourth-generation da Vinci robot. Large multicentre studies are needed to understand whether the new robots could offer advantages other than cost savings over the da Vinci robot.

Development of a software system for surgical robots based on multimodal image fusion: study protocol.

Background: Surgical robots are gaining increasing popularity because of their capability to improve the precision of pedicle screw placement. However, current surgical robots rely on unimodal computed tomography (CT) images as baseline images, limiting their visualization to vertebral bone structures and excluding soft tissue structures such as intervertebral discs and nerves. This inherent limitation significantly restricts the applicability of surgical robots. To address this issue and further enhance the safety and accuracy of robot-assisted pedicle screw placement, this study will develop a software system for surgical robots based on multimodal image fusion. Such a system can extend the application range of surgical robots, such as surgical channel establishment, nerve decompression, and other related operations. Methods: Initially, imaging data of the patients included in the study are collected. Professional workstations are employed to establish, train, validate, and optimize algorithms for vertebral bone segmentation in CT and magnetic resonance (MR) images, intervertebral disc segmentation in MR images, nerve segmentation in MR images, and registration fusion of CT and MR images. Subsequently, a spine application model containing independent modules for vertebrae, intervertebral discs, and nerves is constructed, and a software system for surgical robots based on multimodal image fusion is designed. Finally, the software system is clinically validated. Discussion: We will develop a software system based on multimodal image fusion for surgical robots, which can be applied to surgical access establishment, nerve decompression, and other operations not only for robot-assisted nail placement. The development of this software system is important. First, it can improve the accuracy of pedicle screw placement, percutaneous vertebroplasty, percutaneous kyphoplasty, and other surgeries. Second, it can reduce the number of fluoroscopies, shorten the operation time, and reduce surgical complications. In addition, it would be helpful to expand the application range of surgical robots by providing key imaging data for surgical robots to realize surgical channel establishment, nerve decompression, and other operations.

Head motion-corrected eye gaze tracking with the da Vinci surgical system.

PURPOSE: To facilitate the integration of point of gaze (POG) as an input modality for robot-assisted surgery, we introduce a robust head movement compensation gaze tracking system for the da Vinci Surgical System. Previous surgical eye gaze trackers require multiple recalibrations and suffer from accuracy loss when users move from the calibrated position. We investigate whether eye corner detection can reduce gaze estimation error in a robotic surgery context. METHODS: A polynomial regressor is first used to estimate POG after an 8-point calibration, and then, using another regressor, the POG error from head movement is estimated from the shift in 2D eye corner location. Eye corners are computed by first detecting regions of interest using the You Only Look Once (YOLO) object detector trained on 1600 annotated eye images (open dataset included). Contours are then extracted from the bounding boxes and a derivative-based curvature detector refines the eye corner. RESULTS: Through a user study (n = 24), our corner-contingent head compensation algorithm showed an error reduction in degrees of visual angle of 1.20 ∘ (p = 0.037) for the left eye and 1.26 ∘ (p = 0.079) for the right compared to the previous gold-standard POG error correction method. In addition, the eye corner pipeline showed a root-mean-squared error of 3.57 (SD = 1.92) pixels in detecting eye corners over 201 annotated frames. CONCLUSION: We introduce an effective method of using eye corners to correct for eye gaze estimation, enabling the practical acquisition of POG in robotic surgery.

A surgical activity model of laparoscopic cholecystectomy for co-operation with collaborative robots.

BACKGROUND: Laparoscopic cholecystectomy is a very frequent surgical procedure. However, in an ageing society, less surgical staff will need to perform surgery on patients. Collaborative surgical robots (cobots) could address surgical staff shortages and workload. To achieve context-awareness for surgeon-robot collaboration, the intraoperative action workflow recognition is a key challenge. METHODS: A surgical process model was developed for intraoperative surgical activities including actor, instrument, action and target in laparoscopic cholecystectomy (excluding camera guidance). These activities, as well as instrument presence and surgical phases were annotated in videos of laparoscopic cholecystectomy performed on human patients (n = 10) and on explanted porcine livers (n = 10). The machine learning algorithm Distilled-Swin was trained on our own annotated dataset and the CholecT45 dataset. The validation of the model was conducted using a fivefold cross-validation approach. RESULTS: In total, 22,351 activities were annotated with a cumulative duration of 24.9 h of video segments. The machine learning algorithm trained and validated on our own dataset scored a mean average precision (mAP) of 25.7% and a top K = 5 accuracy of 85.3%. With training and validation on our dataset and CholecT45, the algorithm scored a mAP of 37.9%. CONCLUSIONS: An activity model was developed and applied for the fine-granular annotation of laparoscopic cholecystectomies in two surgical settings. A machine recognition algorithm trained on our own annotated dataset and CholecT45 achieved a higher performance than training only on CholecT45 and can recognize frequently occurring activities well, but not infrequent activities. The analysis of an annotated dataset allowed for the quantification of the potential of collaborative surgical robots to address the workload of surgical staff. If collaborative surgical robots could grasp and hold tissue, up to 83.5% of the assistant's tissue interacting tasks (i.e. excluding camera guidance) could be performed by robots.

Evolving Therapeutic Landscape of Intracerebral Hemorrhage: Emerging Cutting-Edge Advancements in Surgical Robots, Regenerative Medicine, and Neurorehabilitation Techniques.

Intracerebral hemorrhage (ICH) is the most serious form of stroke and has limited available therapeutic options. As knowledge on ICH rapidly develops, cutting-edge techniques in the fields of surgical robots, regenerative medicine, and neurorehabilitation may revolutionize ICH treatment. However, these new advances still must be translated into clinical practice. In this review, we examined several emerging therapeutic strategies and their major challenges in managing ICH, with a particular focus on innovative therapies involving robot-assisted minimally invasive surgery, stem cell transplantation, in situ neuronal reprogramming, and brain-computer interfaces. Despite the limited expansion of the drug armamentarium for ICH over the past few decades, the judicious selection of more efficacious therapeutic modalities and the exploration of multimodal combination therapies represent opportunities to improve patient prognoses after ICH.

A Survey of Needle Steering Approaches in Minimally Invasive Surgery.

In virtue of a curved insertion path inside tissues, needle steering techniques have revealed the potential with the assistance of medical robots and images. The superiority of this technique has been preliminarily verified with several maneuvers: target realignment, obstacle circumvention, and multi-target access. However, the momentum of needle steering approaches in the past decade leads to an open question-"How to choose an applicable needle steering approach for a specific clinical application?" This survey discusses this question in terms of design choices and clinical considerations, respectively. In view of design choices, this survey proposes a hierarchical taxonomy of current needle steering approaches. Needle steering approaches of different manipulations and designs are classified to systematically review the design choices and their influences on clinical treatments. In view of clinical consideration, this survey discusses the steerability and acceptability of the current needle steering approaches. On this basis, the pros and cons of the current needle steering approaches are weighed and their suitable applications are summarized. At last, this survey concluded with an outlook of the needle steering techniques, including the potential clinical applications and future developments in mechanical design.

Stereo attention-based all-in-one super-resolution for robot-assisted minimally invasive surgery.

Robot-assisted minimally invasive surgery (MIS) faces challenges in obtaining high-quality imaging results due to the limited spatial environment. In this paper, we present an all-in-one image super-resolution (SR) algorithm designed to tackle this challenge. By utilizing the stereo information from binocular images, we effectively convert low-resolution images into high-resolution ones. Our model architecture amalgamates the prowess of Convolutional Neural Networks (CNNs) and Transformers, capitalizing on the advantages of both methodologies. To achieve super-resolution across all scale factors, we employ a trainable upsampling module within our proposed network. We substantiate the effectiveness of our method through extensive quantitative and qualitative experiments. The results of our evaluations provide strong evidence supporting the superior performance of our approach in enhancing the quality of surgical images. Our method improves the resolution and thus the overall image quality, which allows the surgeon to perform precise operations conveniently. Simultaneously, it also facilitates the scaling of the region of interest (ROI) to achieve high-quality visualization during surgical procedures. Furthermore, it has the potential to enhance the image quality during telesurgery.

Development of Surgical Robots in Recent Years / 中国医疗器械杂志

OBJECTIVE@#To study the development of surgical robots at home and abroad in recent years.@*METHODS@#Through a large number of literature review and analysis, the qualification approval and technical function characteristics of domestic and foreign surgical robots from January 2019 to July 2022 were analyzed.@*RESULTS@#The related situations of 39 surgical robots were analyzed and reported, and the shortcomings and future development direction of the current surgical robots were summarized.@*CONCLUSIONS@#The development of surgical robots in China is now in a rapid development stage. At present, surgical robots generally have the disadvantages of high cost, lack of tactile feedback (force feedback), large size, large space occupation and difficult to move. In the future, it will develop towards intelligent, miniaturized, remote, open and low-cost.

A Novel Single-arm Single-port Micro-traumatic Laparoscopic Robotic Surgical System / 中国医疗器械杂志

As the robotic assisted single port surgery arousing attention, a novel single-arm single-port micro-traumatic laparoscopic robotic surgical system is proposed in this study. From the perspective of the mechanics, joints with high rigidity and high reliability were utilized to realize the remote center of motion (RCM). Besides, the cost of consumables was reduced by adding the support of the rigid endoscope. From the perspective of the algorithm, high-precision motion control method and feedback force protection mechanism were implemented. The effectiveness of the aforementioned characteristics were verified by five clinical experiments of cholecystectomy. The results showed that the system is able to reduce the amount of bleeding, accelerate the patient recovery, reduce the infection risk and shorten the learning period. The robotic surgical system had significant clinical application value.

A Novel Robotic Bronchoscopic Surgical System / 中国医疗器械杂志

Transbronchil biopsy has the characteristic of less trauma and quick recovery compared to percutaneous aspiration biopsy. In order to automate this procedure, it requires the development of a robotic surgical system that combines electromagnetic navigation and flexible endoscope. The robotic surgical system introduced herein consists of flexible endoscope, remote-control handle, electromagnetic navigation and dexterous manipulators. The robotic system supports lung bronchial model segmentation and reconstruction, automatic bronchial path planning, real-time navigation and visual biopsy. In the control of the endoscopic catheter, an elasticity compensation algorithm was proposed to improve the location accuracy of the catheter and operational efficiency. Clinical trials proved that the robotic system had high positioning accuracy, was intuitive to operate, and could improve the biopsy efficiency, shorten the learning time, reduce the burden of surgical operations, and lower radiation exposure and infection rate.

Research on the Application of Electromagnetic Navigation Technology in Surgical Robots / 中国医疗器械杂志

Due to the need to achieve precise operations during surgery, in order to prevent hand tremors and poor surgical field of view, more and more surgical robots are used in surgical operations combined with navigation technology to meet the requirements for surgical accuracy. Open surgery such as orthopaedics, joint replacement and neurosurgery on the market generally use optical navigation systems to guide robots to achieve precise positioning, but optical navigation systems cannot be used for operations in areas with small surgical space. Therefore, a robotic surgical system based on electromagnetic navigation technology that can be applied to the craniofacial area was proposed. By using this robot, the problems of difficult operation and low precision caused by the narrow craniofacial space can be solved. Key techniques and considerations are studied. The function of the developed prototype is verified through model tests. The test results show that the surgical robot under the electromagnetic navigation technology can achieve precise surgical operations improve the success rate of the doctor's surgery and reduce postoperative complications.

Overview of the Development of Spatial Positioning Accuracy Testing Technology for Surgical Robots / 中国医疗器械杂志

Characteristics of two major categories of RA equipment which defined in the standard are interpreted firstly. Few representative RA equipment in current market and their key product features are introduced. Then, classifications of different indexes of spatial positioning accuracy are declared, the difficulties of performing testing process on each indexes are further explained. Meanwhile, different kinds of three dimensional coordinate measuring equipment that are cutting edge at present stage are introduced with their main methods of use explained. According to characteristics of three dimensional coordinate measuring equipment on the market, proper measuring equipment for testing certain index of spatial positioning accuracy and corresponding experiment method are introduced.

Emergency iliosacral screw fixation assisted by TiRobot for unstable posterior pelvic ring fracture / 中华创伤骨科杂志

Objective:To evaluate the emergency iliosacral screw fixation assisted by TiRobot for unstable posterior pelvic ring fracture.Methods:The 26 patients with unstable pelvic fracture were analyzed retrospectively who had undergone emergency iliosacral screw fixation at Department of Orthopedics & Traumatology, Beijing Jishuitan Hospital from June 2018 to December 2020. They were divided into 2 groups depending on whether orthopaedic TiRobot was used to assist screw insertion. In the observation group of 14 cases subjected to TiRobot-assisted insertion of iliosacral screws, there were 10 males and 4 females with an age of (45.9 ± 10.1) years; in the control group of 12 cases subjected to conventional manual insertion of iliosacral screws, there were 9 males and 3 females with an age of (49.2 ± 11.3) years. All the surgeries were conducted within 24 hours after injury. The 2 groups were compared in terms of screw insertion time, pin insertion, intraoperative blood loss, fluoroscopy time, postoperative screw position, fracture reduction and Harris hip score at the final follow-up.Results:The 2 groups were comparable because there was no significant difference between them in their preoperative general clinical data or follow-up time ( P>0.05). The screw insertion time [(16.1 ± 3.4) min] and fluoroscopy time [(8.1 ± 3.3) s] in the observation group were significantly shorter than those in the control group [(26.4 ± 5.4) min and (25.2 ± 7.4) s], and the pin insertions [1 (1, 2) times] and intraoperative blood loss [(10.5 ± 6.4) mL] in the former were significantly less than those in the latter [6 (3, 8) times and (24.8 ± 6.7) mL] (all P<0.05). Postoperatively, the sacroiliac screw position was excellent in 18 cases and good in 2 in the observation group while excellent in 14 cases, good in 2 and poor in 2 in the control group; the fracture reduction was excellent in 12 cases, good in one and fair in one in the observation group while excellent in 10 cases, good in one and fair in one in the control group, showing insignificant differences in the above comparisons ( P>0.05). There was no significant difference either in the Harris hip score at the final follow-up between the 2 groups ( P>0.05). Conclusion:Compared with conventional manual insertion of iliosacral screws, emergency iliosacral screw fixation assisted by TiRobot can effectively decrease surgical time and reduce operative invasion due to a higher accuracy rate of screw insertion.

Review of surgical robotic systems for keyhole and endoscopic procedures: state of the art and perspectives / 医学前沿

Minimally invasive surgery, including laparoscopic and thoracoscopic procedures, benefits patients in terms of improved postoperative outcomes and short recovery time. The challenges in hand-eye coordination and manipulation dexterity during the aforementioned procedures have inspired an enormous wave of developments on surgical robotic systems to assist keyhole and endoscopic procedures in the past decades. This paper presents a systematic review of the state-of-the-art systems, picturing a detailed landscape of the system configurations, actuation schemes, and control approaches of the existing surgical robotic systems for keyhole and endoscopic procedures. The development challenges and future perspectives are discussed in depth to point out the need for new enabling technologies and inspire future researches.