Assessment of Helicobacter pylori infection by deep learning based on endoscopic videos in real time.

BACKGROUND AND AIMS: Endoscopic assessment of Helicobacter pylori infection is a simple and effective method. Here, we aimed to develop a deep learning-based system named Intelligent Detection Endoscopic Assistant-Helicobacter pylori (IDEA-HP) to assess H. pylori infection by using endoscopic videos in real time. METHODS: Endoscopic data were retrospectively obtained from Zhejiang Cancer Hospital (ZJCH) for the development, validation, and testing of the system. Stored videos from ZJCH were used for assessing and comparing the performance of IDEA-HP with that of endoscopists. Prospective consecutive patients undergoing esophagogastroduodenoscopy were enrolled to assess the applicability of clinical practice. The urea breath test was used as the gold standard for diagnosing H. pylori infection. RESULTS: In 100 videos, IDEA-HP achieved a similar overall accuracy of assessing H. pylori infection to that of experts (84.0% vs. 83.6% [P = 0.729]). Nevertheless, the diagnostic accuracy (84.0% vs. 74.0% [P<0.001]) and sensitivity (82.0% vs. 67.2% [P<0.001]) of IDEA-HP were significantly higher than those of the beginners. In 191 prospective consecutive patients, IDEA-HP achieved accuracy, sensitivity, and specificity of 85.3% (95% CI: 79.0%-89.3%), 83.3% (95% CI: 72.8%-90.5%), and 85.8% (95% CI: 77.7%-91.4%), respectively. CONCLUSIONS: Our results show that IDEA-HP has great potential for assisting endoscopists in assessing H. pylori infection status during actual clinical work.

A mucosal recovery software tool for endoscopic submucosal dissection in early gastric cancer.

Background: Due to the limited diagnostic ability, the low detection rate of early gastric cancer (EGC) is a serious health threat. The establishment of the mapping between endoscopic images and pathological images can rapidly improve the diagnostic ability to detect EGC. To expedite the learning process of EGC diagnosis, a mucosal recovery map for the mapping between ESD mucosa specimen and pathological images should be performed in collaboration with endoscopists and pathologists, which is a time-consuming and laborious work. Methods: 20 patients at the Zhejiang Provincial People's Hospital, Affiliated People's Hospital of Hangzhou Medical College from March 2020 to July 2020 were enrolled in this study. We proposed the improved U-Net to obtain WSI-level segmentation results, and the WSI-level results can be mapped to the macroscopic image of the specimen. For the convenient use, a software pipeline named as "Pathology Helper" for integration the workflow of the construction of mucosal recovery maps was developed. Results: The MIoU and Dice of our model can achieve 0.955 ± 0.0936 and 0.961 ± 0.0874 for WSI-level segmentation, respectively. With the help of "Pathology Helper", we can construct the high-quality mucosal recovery maps to reduce the workload of endoscopists and pathologists. Conclusion: "Pathology Helper" will accelerate the learning of endoscopists and pathologists, and rapidly improve their abilities to detect EGC. Our work can also improve the detection rate of early gastric cancer, so that more patients with gastric cancer will be treated in a timely manner.

Study on Molecular Information Intelligent Diagnosis and Treatment of Bladder Cancer on Pathological Tissue Image.

Background: Molecular information about bladder cancer is significant for treatment and prognosis. The immunohistochemistry (IHC) method is widely used to analyze the specific biomarkers to determine molecular subtypes. However, procedures in IHC and plenty of reagents are time and labor-consuming and expensive. This study established a computer-aid diagnosis system for predicting molecular subtypes, p53 status, and programmed death-ligand 1 (PD-L1) status of bladder cancer with pathological images. Materials and Methods: We collected 119 muscle-invasive bladder cancer (MIBC) patients who underwent radical cystectomy from January 2016 to September 2018. All the pathological sections are scanned into digital whole slide images (WSIs), and the IHC results of adjacent sections were recorded as the label of the corresponding slide. The tumor areas are first segmented, then molecular subtypes, p53 status, and PD-L1 status of those tumor-positive areas would be identified by three independent convolutional neural networks (CNNs). We measured the performance of this system for predicting molecular subtypes, p53 status, and PD-L1 status of bladder cancer with accuracy, sensitivity, and specificity. Results: For the recognition of molecular subtypes, the accuracy is 0.94, the sensitivity is 1.00, and the specificity is 0.909. For PD-L1 status recognition, the accuracy is 0.897, the sensitivity is 0.875, and the specificity is 0.913. For p53 status recognition, the accuracy is 0.846, the sensitivity is 0.857, and the specificity is 0.750. Conclusion: Our computer-aided diagnosis system can provide a novel and simple assistant tool to obtain the molecular subtype, PD-L1 status, and p53 status. It can reduce the workload of pathologists and the medical cost.

"Pink Pattern" Visualized in Magnifying Endoscopy With Narrow-Band Imaging Is a Novel Feature of Early Differentiated Gastric Cancer: A Bridge Between Endoscopic Images and Histopathological Changes.

Background: A pink color change occasionally found by us under magnifying endoscopy with narrow-band imaging (ME-NBI) may be a special feature of early gastric cancer (EGC), and was designated the "pink pattern". The purposes of this study were to determine the relationship between the pink pattern and the cytopathological changes in gastric cancer cells and whether the pink pattern is useful for the diagnosis of EGC. Methods: The color features of ME-NBI images and pathological images of cancerous gastric mucosal surfaces were extracted and quantified. The cosine similarity was calculated to evaluate the correlation between the pink pattern and the nucleus-to-cytoplasm ratio of cancerous epithelial cells. Two diagnostic tests were performed by 12 endoscopists using stored ME-NBI images of 185 gastric lesions to investigate the diagnostic efficacy of the pink pattern for EGC. The diagnostic values, such as the area under the curve (AUC), the accuracy, sensitivity, specificity, positive predictive value (PPV), and negative predictive value (NPV), of test 1 and test 2 were compared. Results: The cosine similarity between the color values of ME-NBI images and pathological images of 20 lesions was at least 0.744. The median AUC, accuracy, sensitivity, specificity, PPV, and NPV of test 2 were significantly better than those of test 1 for all endoscopists and for the junior and experienced groups. Conclusions: The pink pattern observed in ME-NBI images correlated strongly with the change in the nucleus-to-cytoplasm ratio of gastric epithelial cells, and could be considered a useful marker for the diagnosis of differentiated EGC.

Intelligent detection endoscopic assistant: An artificial intelligence-based system for monitoring blind spots during esophagogastroduodenoscopy in real-time.

BACKGROUND: Observation of the entire stomach during esophagogastroduodenoscopy (EGD) is important; however, there is a lack of effective evaluation tools. AIMS: To develop an artificial intelligence (AI)-assisted EGD system able to automatically monitor blind spots in real-time. METHODS: An AI-based system, called the Intelligent Detection Endoscopic Assistant (IDEA), was developed using a deep convolutional neural network (DCNN) and long short-term memory (LSTM). The performance of IDEA for recognition of gastric sites in images and videos was evaluated. Primary outcomes included diagnostic accuracy, sensitivity, and specificity. RESULTS: A total of 170,297 images and 5779 endoscopic videos were collected to develop the system. As the test group, 3100 EGD images were acquired to evaluate the performance of DCNN in recognition of gastric sites in images. The sensitivity, specificity, and accuracy of DCNN were determined as 97.18%,99.91%, and 99.83%, respectively. To assess the performance of IDEA in recognition of gastric sites in EGD videos, 129 videos were used as the test group. The sensitivity, specificity, and accuracy of IDEA were 96.29%,93.32%, and 95.30%, respectively. CONCLUSIONS: IDEA achieved high accuracy for recognition of gastric sites in real-time. The system can be applied as a powerful assistant tool for monitoring blind spots during EGD.