Intraoperative artificial intelligence system identifying liver vessels in laparoscopic liver resection: a retrospective experimental study.

BACKGROUND: The precise recognition of liver vessels during liver parenchymal dissection is the crucial technique for laparoscopic liver resection (LLR). This retrospective feasibility study aimed to develop artificial intelligence (AI) models to recognize liver vessels in LLR, and to evaluate their accuracy and real-time performance. METHODS: Images from LLR videos were extracted, and the hepatic veins and Glissonean pedicles were labeled separately. Two AI models were developed to recognize liver vessels: the "2-class model" which recognized both hepatic veins and Glissonean pedicles as equivalent vessels and distinguished them from the background class, and the "3-class model" which recognized them all separately. The Feature Pyramid Network was used as a neural network architecture for both models in their semantic segmentation tasks. The models were evaluated using fivefold cross-validation tests, and the Dice coefficient (DC) was used as an evaluation metric. Ten gastroenterological surgeons also evaluated the models qualitatively through rubric. RESULTS: In total, 2421 frames from 48 video clips were extracted. The mean DC value of the 2-class model was 0.789, with a processing speed of 0.094 s. The mean DC values for the hepatic vein and the Glissonean pedicle in the 3-class model were 0.631 and 0.482, respectively. The average processing time for the 3-class model was 0.097 s. Qualitative evaluation by surgeons revealed that false-negative and false-positive ratings in the 2-class model averaged 4.40 and 3.46, respectively, on a five-point scale, while the false-negative, false-positive, and vessel differentiation ratings in the 3-class model averaged 4.36, 3.44, and 3.28, respectively, on a five-point scale. CONCLUSION: We successfully developed deep-learning models that recognize liver vessels in LLR with high accuracy and sufficient processing speed. These findings suggest the potential of a new real-time automated navigation system for LLR.

Machine learning-based Automatic Evaluation of Tissue Handling Skills in Laparoscopic Colorectal Surgery: A Retrospective Experimental Study.

OBJECTIVE: To develop a machine learning model that automatically quantifies the spread of blood in the surgical field using intraoperative videos of laparoscopic colorectal surgery and evaluate whether the index measured with the developed model can be used to assess tissue handling skill. BACKGROUND: Although skill evaluation is crucial in laparoscopic surgery, existing evaluation systems suffer from evaluator subjectivity and are labor-intensive. Therefore, automatic evaluation using machine learning is potentially useful. MATERIALS AND METHODS: In this retrospective experimental study, we used training data with annotated labels of blood or non-blood pixels on intraoperative images to develop a machine learning model to classify pixel RGB values into blood and non-blood. The blood pixel count per frame (the total number of blood pixels throughout a surgery divided by the number of frames) was compared among groups of surgeons with different tissue handling skills. RESULTS: The overall accuracy of the machine learning model for the blood classification task was 85.7%. The high tissue handling skill group had the lowest blood pixel count per frame, and the novice surgeon group had the highest count (mean [SD]: high tissue handling skill group 20972.23 [19287.05] vs. low tissue handling skill group 34473.42 [28144.29] vs. novice surgeon group 50630.04 [42427.76], P <0.01). The difference between any 2 groups was significant. CONCLUSIONS: We developed a machine learning model to measure blood pixels in laparoscopic colorectal surgery images using RGB information. The blood pixel count per frame measured with this model significantly correlated with surgeons' tissue handling skills.

Automated surgical workflow identification by artificial intelligence in laparoscopic hepatectomy: Experimental research.

BACKGROUND: To perform accurate laparoscopic hepatectomy (LH) without injury, novel intraoperative systems of computer-assisted surgery (CAS) for LH are expected. Automated surgical workflow identification is a key component for developing CAS systems. This study aimed to develop a deep-learning model for automated surgical step identification in LH. MATERIALS AND METHODS: We constructed a dataset comprising 40 cases of pure LH videos; 30 and 10 cases were used for the training and testing datasets, respectively. Each video was divided into 30 frames per second as static images. LH was divided into nine surgical steps (Steps 0-8), and each frame was annotated as being within one of these steps in the training set. After extracorporeal actions (Step 0) were excluded from the video, two deep-learning models of automated surgical step identification for 8-step and 6-step models were developed using a convolutional neural network (Models 1 & 2). Each frame in the testing dataset was classified using the constructed model performed in real-time. RESULTS: Above 8 million frames were annotated for surgical step identification from the pure LH videos. The overall accuracy of Model 1 was 0.891, which was increased to 0.947 in Model 2. Median and average accuracy for each case in Model 2 was 0.927 (range, 0.884-0.997) and 0.937 ± 0.04 (standardized difference), respectively. Real-time automated surgical step identification was performed at 21 frames per second. CONCLUSIONS: We developed a highly accurate deep-learning model for surgical step identification in pure LH. Our model could be applied to intraoperative systems of CAS.

Hypothyroidism and hypopituitarism as immune-related adverse events due to lenvatinib plus pembrolizumab therapy in the immediate postoperative period after laparoscopic hepatectomy for liver metastases from gastric cancer: a case report.

BACKGROUND: Immune checkpoint inhibitors (ICIs) are emerging agents used for the treatment of various malignant tumors. As ICIs are generally used for unresectable malignant tumors, there have been only a few reports of patients who underwent surgery after receiving these drugs. Therefore, it remains unclear how immune-related adverse events (irAEs) affect the postoperative course. Here, we report a patient with advanced gastric cancer who underwent laparoscopic hepatectomy for liver metastases after an objective response with lenvatinib plus pembrolizumab and developed hypothyroidism and hypopituitarism as irAEs in the immediate postoperative period. CASE PRESENTATION: A 73-year-old man had undergone total gastrectomy for pT4aN2M0 gastric cancer followed by adjuvant chemotherapy with S-1 and docetaxel, and developed liver metastases in segments 6 and 7. He was enrolled in phase 2 clinical trial of lenvatinib plus pembrolizumab. He continuously achieved a partial response with the study treatment, and the liver metastases were decreased in size on imaging. The tumors were judged to be resectable and the patient underwent laparoscopic partial hepatectomy for segments 6 and 7. From the 1st postoperative day, the patient continuously presented with fever and general fatigue, and his fasting blood glucose level remained slightly lower than that before the surgery. On the 4th postoperative day, laboratory examination revealed hypothyroidism and hypopituitarism, which were suspected to be irAE caused by lenvatinib plus pembrolizumab after surgery. He received hydrocortisone first, followed by levothyroxine after adrenal insufficiency was recovered. Subsequently, his fever, general fatigue, and any abnormality regarding fasting blood glucose level resolved, and he was discharged on the 12th postoperative day. After discharge, his laboratory data for thyroid and pituitary function remained stable while receiving hydrocortisone and levothyroxine without recurrence of gastric cancer. CONCLUSION: We present a case of laparoscopic hepatectomy after receiving lenvatinib plus pembrolizumab and developed hypothyroidism and hypopituitarism after surgery. Regarding surgery after ICI therapy, it is important to recognize that irAEs might occur in the postoperative period.