A Deep Learning-Based, Real-Time Image Report System for Linear Endoscopic Ultrasound.

BACKGROUND AND AIMS: The integrity of image acquisition is critical for biliopancreatic Endoscopic Ultrasonography (EUS) reporting, significantly affecting the quality of EUS examinations and disease-related decision-making. However, the quality of EUS reports varies among endoscopists. To address this, we developed a deep learning-based EUS automatic image reporting system (EUS-AIRS), aiming to achieve automatic photodocumentation in real-time during EUS, including capturing standard stations, lesions, and puncture procedures. METHODS: Eight deep learning models trained and tested using 235,784 images were integrated to construct the EUS-AIRS. We tested the performance of EUS-AIRS through man-machine comparison at two levels: retrospective test (include internal and external test), and prospective test. From May 2023 to October 2023, 114 patients undergoing EUS at Renmin Hospital of Wuhan University were consecutively recruited for prospective test. The primary outcome was the completeness of the EUS-AIRS for capturing standard stations. RESULTS: In terms of completeness in capturing biliopancreatic standard stations, EUS-AIRS exceeds the capabilities of endoscopists at all levels of expertise in retrospective internal (90.8% [95%CI 88.7%-92.9%] vs. 70.5% [95%CI 67.2%-73.8%], p<0.001), and external test (91.4% [95%CI 88.4%-94.4%] vs 68.2% [95%CI 63.3%-73.2%], p<0.001). EUS-AIRS demonstrated high accuracy and completeness in capturing standard station images. The completeness significantly outperformed manual endoscopist reports: 91.4% [95%CI, 89.4% - 93.4%] vs. 78.1% [95%CI, 75.1% - 81.0%), p<0.001. CONCLUSIONS: EUS-AIRS exhibits exceptional capabilities in real-time capturing high-quality and high-integrity biliopancreatic EUS images, showcasing the potential of applying an artificial intelligence image reporting system in the EUS field.

Multistep validation of a post-ERCP pancreatitis prediction system integrating multimodal data: a multicenter study.

BACKGROUND AND AIMS: The impact of various categories of information on the prediction of post-ERCP pancreatitis (PEP) remains uncertain. We comprehensively investigated the risk factors associated with PEP by constructing and validating a model incorporating multimodal data through multiple steps. METHODS: Cases (n = 1916) of ERCP were retrospectively collected from multiple centers for model construction. Through literature research, 49 electronic health record (EHR) features and 1 image feature related to PEP were identified. The EHR features were categorized into baseline, diagnosis, technique, and prevention strategies, covering pre-ERCP, intra-ERCP, and peri-ERCP phases. We first incrementally constructed models 1 to 4 incorporating these 4 feature categories and then added the image feature into models 1 to 4 and developed models 5 to 8. All models underwent testing and comparison using both internal and external test sets. Once the optimal model was selected, we conducted comparisons among multiple machine learning algorithms. RESULTS: Compared with model 2 that incorporated baseline and diagnosis features, adding technique and prevention strategies (model 4) greatly improved the sensitivity (63.89% vs 83.33%, P < .05) and specificity (75.00% vs 85.92%, P < .001). A similar tendency was observed in the internal and external tests. In model 4, the top 3 features ranked by weight were previous pancreatitis, nonsteroidal anti-inflammatory drug use, and difficult cannulation. The image-based feature has the highest weight in models 5 to 8. Finally, model 8 used a random forest algorithm and showed the best performance. CONCLUSIONS: We first developed a multimodal prediction model for identifying PEP with a clinical-acceptable performance. The image and technique features are crucial for PEP prediction.

Effect of artificial intelligence on novice-performed colonoscopy: a multicenter randomized controlled tandem study.

BACKGROUND AND AIMS: The efficacy and safety of colonoscopy performed by artificial intelligence (AI)-assisted novices remain unknown. The aim of this study was to compare the lesion detection capability of novices, AI-assisted novices, and experts. METHODS: This multicenter, randomized, noninferiority tandem study was conducted across 3 hospitals in China from May 1, 2022, to November 11, 2022. Eligible patients were randomized into 1 of 3 groups: the CN group (control novice group, withdrawal performed by a novice independently), the AN group (AI-assisted novice group, withdrawal performed by a novice with AI assistance), or the CE group (control expert group, withdrawal performed by an expert independently). Participants underwent a repeat colonoscopy conducted by an AI-assisted expert to evaluate the lesion miss rate and ensure lesion detection. The primary outcome was the adenoma miss rate (AMR). RESULTS: A total of 685 eligible patients were analyzed: 229 in the CN group, 227 in the AN group, and 229 in the CE group. Both AMR and polyp miss rate were lower in the AN group than in the CN group (18.82% vs 43.69% [P < .001] and 21.23% vs 35.38% [P < .001], respectively). The noninferiority margin was met between the AN and CE groups of both AMR and polyp miss rate (18.82% vs 26.97% [P = .202] and 21.23% vs 24.10% [P < .249]). CONCLUSIONS: AI-assisted colonoscopy lowered the AMR of novices, making them noninferior to experts. The withdrawal technique of new endoscopists can be enhanced by AI-assisted colonoscopy. (Clinical trial registration number: NCT05323279.).

Validation of artificial intelligence-based bowel preparation assessment in screening colonoscopy (with video).

BACKGROUND AND AIMS: Accurate bowel preparation assessment is essential for determining colonoscopy screening intervals. Patients with suboptimal bowel preparation are at a high risk of missing >5 mm adenomas and should undergo an early repeat colonoscopy. In this study, we used artificial intelligence (AI) to evaluate bowel preparation and validated the ability of the system to accurately identify patients who are at high risk of having >5 mm adenomas missed due to inadequate bowel preparation. METHODS: This prospective, single-center, observational study was conducted at the Eighth Affiliated Hospital, Sun Yat-sen University, from October 8, 2021, to November 9, 2022. Eligible patients who underwent screening colonoscopy were consecutively enrolled. The AI assessed bowel preparation using the e-Boston Bowel Preparation Scale (e-BBPS) while endoscopists made evaluations using BBPS. If both BBPS and e-BBPS deemed preparation adequate, the patient immediately underwent a second colonoscopy; otherwise, the patient underwent bowel re-cleansing before the second colonoscopy. RESULTS: Among the 393 patients, 72 adenomas >5 mm in size were detected; 27 adenomas >5 mm in size were missed. In unqualified-AI patients, the >5 mm adenoma miss rate (AMR) was significantly higher than in qualified-AI patients (35.71% vs 13.19% [P = .0056]; odds ratio [OR], .2734 [95% CI, .1139-.6565]), as were the AMR (50.89% vs 20.79% [P < .001]; OR, .2532 [95% CI, .1583-.4052]) and >5 mm polyp miss rate (35.82% vs 19.48% [P = .0152]; OR, .4335 [95% CI, .2288-.8213]). CONCLUSIONS: This study confirmed that patients classified as inadequate by AI exhibited an unacceptable >5 mm AMR, providing key evidence for implementing AI in guiding bowel re-cleansing and potentially standardizing future colonoscopy screening. (Clinical trial registration number: NCT05145712.).

A real-time deep learning-based system for colorectal polyp size estimation by white-light endoscopy: development and multicenter prospective validation.

BACKGROUND: The choice of polypectomy device and surveillance intervals for colorectal polyps are primarily decided by polyp size. We developed a deep learning-based system (ENDOANGEL-CPS) to estimate colorectal polyp size in real time. METHODS: ENDOANGEL-CPS calculates polyp size by estimating the distance from the endoscope lens to the polyp using the parameters of the lens. The depth estimator network was developed on 7297 images from five virtually produced colon videos and tested on 730 images from seven virtual colon videos. The performance of the system was first evaluated in nine videos of a simulated colon with polyps attached, then tested in 157 real-world prospective videos from three hospitals, with the outcomes compared with that of nine endoscopists over 69 videos. Inappropriate surveillance recommendations caused by incorrect estimation of polyp size were also analyzed. RESULTS: The relative error of depth estimation was 11.3% (SD 6.0%) in successive virtual colon images. The concordance correlation coefficients (CCCs) between system estimation and ground truth were 0.89 and 0.93 in images of a simulated colon and multicenter videos of 157 polyps. The mean CCC of ENDOANGEL-CPS surpassed all endoscopists (0.89 vs. 0.41 [SD 0.29]; P<0.001). The relative accuracy of ENDOANGEL-CPS was significantly higher than that of endoscopists (89.9% vs. 54.7%; P<0.001). Regarding inappropriate surveillance recommendations, the system's error rate is also lower than that of endoscopists (1.5% vs. 16.6%; P<0.001). CONCLUSIONS: ENDOANGEL-CPS could potentially improve the accuracy of colorectal polyp size measurements and size-based surveillance intervals.

A newly developed deep learning-based system for automatic detection and classification of small bowel lesions during double-balloon enteroscopy examination.

BACKGROUND: Double-balloon enteroscopy (DBE) is a standard method for diagnosing and treating small bowel disease. However, DBE may yield false-negative results due to oversight or inexperience. We aim to develop a computer-aided diagnostic (CAD) system for the automatic detection and classification of small bowel abnormalities in DBE. DESIGN AND METHODS: A total of 5201 images were collected from Renmin Hospital of Wuhan University to construct a detection model for localizing lesions during DBE, and 3021 images were collected to construct a classification model for classifying lesions into four classes, protruding lesion, diverticulum, erosion & ulcer and angioectasia. The performance of the two models was evaluated using 1318 normal images and 915 abnormal images and 65 videos from independent patients and then compared with that of 8 endoscopists. The standard answer was the expert consensus. RESULTS: For the image test set, the detection model achieved a sensitivity of 92% (843/915) and an area under the curve (AUC) of 0.947, and the classification model achieved an accuracy of 86%. For the video test set, the accuracy of the system was significantly better than that of the endoscopists (85% vs. 77 ± 6%, p < 0.01). For the video test set, the proposed system was superior to novices and comparable to experts. CONCLUSIONS: We established a real-time CAD system for detecting and classifying small bowel lesions in DBE with favourable performance. ENDOANGEL-DBE has the potential to help endoscopists, especially novices, in clinical practice and may reduce the miss rate of small bowel lesions.

Gastric neoplasm detection of computer-aided detection-assisted esophagogastroduodenoscopy changes with implement scenarios: a real-world study.

BACKGROUND AND AIM: The implementation of computer-aided detection (CAD) devices in esophagogastroduodenoscopy (EGD) could autonomously identify gastric precancerous lesions and neoplasms and reduce the miss rate of gastric neoplasms in prospective trials. However, there is still insufficient evidence of their use in real-life clinical practice. METHODS: A real-world, two-center study was conducted at Wenzhou Central Hospital (WCH) and Renmin Hospital of Wuhan University (RHWU). High biopsy rate and low biopsy rate strategies were adopted, and CAD devices were applied in 2019 and 2021 at WCH and RHWU, respectively. We compared differences in gastric precancerous and neoplasm detection of EGD before and after the use of CAD devices in the first half of the year. RESULTS: A total of 33 885 patients were included and 32 886 patients were ultimately analyzed. In WCH of which biopsy rate >95%, with the implementation of CAD, more the number of early gastric cancer divided by all gastric neoplasm (EGC/GN) (0.35% vs 0.59%, P = 0.028, OR [95% CI] = 1.65 [1.0-2.60]) was found, while gastric neoplasm detection rate (1.39% vs 1.36%, P = 0.897, OR [95% CI] = 0.98 [0.76-1.26]) remained stable. In RHWU of which biopsy rate <20%, the gastric neoplasm detection rate (1.78% vs 3.23%, P < 0.001, OR [95% CI] = 1.84 [1.33-2.54]) nearly doubled after the implementation of CAD, while there was no significant change in the EGC/GN. CONCLUSION: The application of CAD devices devoted to distinct increases in gastric neoplasm detection according to different biopsy strategies, which implied that CAD devices demonstrated assistance on gastric neoplasm detection while varied effectiveness according to different implementation scenarios.

Assessment of the role of false-positive alerts in computer-aided polyp detection for assistance capabilities.

BACKGROUND AND AIM: False positives (FPs) pose a significant challenge in the application of artificial intelligence (AI) for polyp detection during colonoscopy. The study aimed to quantitatively evaluate the impact of computer-aided polyp detection (CADe) systems' FPs on endoscopists. METHODS: The model's FPs were categorized into four gradients: 0-5, 5-10, 10-15, and 15-20 FPs per minute (FPPM). Fifty-six colonoscopy videos were collected for a crossover study involving 10 endoscopists. Polyp missed rate (PMR) was set as primary outcome. Subsequently, to further verify the impact of FPPM on the assistance capability of AI in clinical environments, a secondary analysis was conducted on a prospective randomized controlled trial (RCT) from Renmin Hospital of Wuhan University in China from July 1 to October 15, 2020, with the adenoma detection rate (ADR) as primary outcome. RESULTS: Compared with routine group, CADe reduced PMR when FPPM was less than 5. However, with the continuous increase of FPPM, the beneficial effect of CADe gradually weakens. For secondary analysis of RCT, a total of 956 patients were enrolled. In AI-assisted group, ADR is higher when FPPM ≤ 5 compared with FPPM > 5 (CADe group: 27.78% vs 11.90%; P = 0.014; odds ratio [OR], 0.351; 95% confidence interval [CI], 0.152-0.812; COMBO group: 38.40% vs 23.46%, P = 0.029; OR, 0.427; 95% CI, 0.199-0.916). After AI intervention, ADR increased when FPPM ≤ 5 (27.78% vs 14.76%; P = 0.001; OR, 0.399; 95% CI, 0.231-0.690), but no statistically significant difference was found when FPPM > 5 (11.90% vs 14.76%, P = 0.788; OR, 1.111; 95% CI, 0.514-2.403). CONCLUSION: The level of FPs of CADe does affect its effectiveness as an aid to endoscopists, with its best effect when FPPM is less than 5.

The effect of incorporating domain knowledge with deep learning in identifying benign and malignant gastric whitish lesions: A retrospective study.

BACKGROUND AND AIM: Early whitish gastric neoplasms can be easily misdiagnosed; differential diagnosis of gastric whitish lesions remains a challenge. We aim to build a deep learning (DL) model to diagnose whitish gastric neoplasms and explore the effect of adding domain knowledge in model construction. METHODS: We collected 4558 images from two institutions to train and test models. We first developed two sole DL models (1 and 2) using supervised and semi-supervised algorithms. Then we selected diagnosis-related features through literature research and developed feature-extraction models to determine features including boundary, surface, roundness, depression, and location. Then predictions of the five feature-extraction models and sole DL model were combined and inputted into seven machine-learning (ML) based fitting-diagnosis models. The optimal model was selected as ENDOANGEL-WD (whitish-diagnosis) and compared with endoscopists. RESULTS: Sole DL 2 had higher sensitivity (83.12% vs 68.67%, Bonferroni adjusted P = 0.024) than sole DL 1. Adding domain knowledge, the decision tree performed best among the seven ML models, achieving higher specificity than DL 1 (84.38% vs 72.27%, Bonferroni adjusted P < 0.05) and higher accuracy than DL 2 (80.47%, Bonferroni adjusted P < 0.001) and was selected as ENDOANGEL-WD. ENDOANGEL-WD showed better accuracy compared with 10 endoscopists (75.70%, P < 0.001). CONCLUSIONS: We developed a novel system ENDOANGEL-WD combining domain knowledge and traditional DL to detect gastric whitish neoplasms. Adding domain knowledge improved the performance of traditional DL, which provided a novel solution for establishing diagnostic models for other rare diseases potentially.

Current status of quality control in screening esophagogastroduodenoscopy and the emerging role of artificial intelligence.

Esophagogastroduodenoscopy (EGD) screening is being implemented in countries with a high incidence of upper gastrointestinal (UGI) cancer. High-quality EGD screening ensures the yield of early diagnosis and prevents suffering from advanced UGI cancer and minimal operational-related discomfort. However, performance varied dramatically among endoscopists, and quality control for EGD screening remains suboptimal. Guidelines have recommended potential measures for endoscopy quality improvement and research has been conducted for evidence. Moreover, artificial intelligence offers a promising solution for computer-aided diagnosis and quality control during EGD examinations. In this review, we summarized the key points for quality assurance in EGD screening based on current guidelines and evidence. We also outline the latest evidence, limitations, and future prospects of the emerging role of artificial intelligence in EGD quality control, aiming to provide a foundation for improving the quality of EGD screening.

Impact of Artificial Intelligence on Colonoscopy Surveillance After Polyp Removal: A Pooled Analysis of Randomized Trials.

BACKGROUND AND AIMS: Artificial intelligence (AI) tools aimed at improving polyp detection have been shown to increase the adenoma detection rate during colonoscopy. However, it is unknown how increased polyp detection rates by AI affect the burden of patient surveillance after polyp removal. METHODS: We conducted a pooled analysis of 9 randomized controlled trials (5 in China, 2 in Italy, 1 in Japan, and 1 in the United States) comparing colonoscopy with or without AI detection aids. The primary outcome was the proportion of patients recommended to undergo intensive surveillance (ie, 3-year interval). We analyzed intervals for AI and non-AI colonoscopies for the U.S. and European recommendations separately. We estimated proportions by calculating relative risks using the Mantel-Haenszel method. RESULTS: A total of 5796 patients (51% male, mean 53 years of age) were included; 2894 underwent AI-assisted colonoscopy and 2902 non-AI colonoscopy. When following U.S. guidelines, the proportion of patients recommended intensive surveillance increased from 8.4% (95% CI, 7.4%-9.5%) in the non-AI group to 11.3% (95% CI, 10.2%-12.6%) in the AI group (absolute difference, 2.9% [95% CI, 1.4%-4.4%]; risk ratio, 1.35 [95% CI, 1.16-1.57]). When following European guidelines, it increased from 6.1% (95% CI, 5.3%-7.0%) to 7.4% (95% CI, 6.5%-8.4%) (absolute difference, 1.3% [95% CI, 0.01%-2.6%]; risk ratio, 1.22 [95% CI, 1.01-1.47]). CONCLUSIONS: The use of AI during colonoscopy increased the proportion of patients requiring intensive colonoscopy surveillance by approximately 35% in the United States and 20% in Europe (absolute increases of 2.9% and 1.3%, respectively). While this may contribute to improved cancer prevention, it significantly adds patient burden and healthcare costs.

Effect of a deep learning-based automatic upper GI endoscopic reporting system: a randomized crossover study (with video).

BACKGROUND AND AIMS: EGD is essential for GI disorders, and reports are pivotal to facilitating postprocedure diagnosis and treatment. Manual report generation lacks sufficient quality and is labor intensive. We reported and validated an artificial intelligence-based endoscopy automatic reporting system (AI-EARS). METHODS: The AI-EARS was designed for automatic report generation, including real-time image capturing, diagnosis, and textual description. It was developed using multicenter datasets from 8 hospitals in China, including 252,111 images for training, 62,706 images, and 950 videos for testing. Twelve endoscopists and 44 endoscopy procedures were consecutively enrolled to evaluate the effect of the AI-EARS in a multireader, multicase, crossover study. The precision and completeness of the reports were compared between endoscopists using the AI-EARS and conventional reporting systems. RESULTS: In video validation, the AI-EARS achieved completeness of 98.59% and 99.69% for esophageal and gastric abnormality records, respectively, accuracies of 87.99% and 88.85% for esophageal and gastric lesion location records, and 73.14% and 85.24% for diagnosis. Compared with the conventional reporting systems, the AI-EARS achieved greater completeness (79.03% vs 51.86%, P < .001) and accuracy (64.47% vs 42.81%, P < .001) of the textual description and completeness of the photo-documents of landmarks (92.23% vs 73.69%, P < .001). The mean reporting time for an individual lesion was significantly reduced (80.13 ± 16.12 seconds vs 46.47 ± 11.68 seconds, P < .001) after the AI-EARS assistance. CONCLUSIONS: The AI-EARS showed its efficacy in improving the accuracy and completeness of EGD reports. It might facilitate the generation of complete endoscopy reports and postendoscopy patient management. (Clinical trial registration number: NCT05479253.).

An artificial intelligence difficulty scoring system for stone removal during ERCP: a prospective validation.

BACKGROUND: A computer-assisted (CAD) system was developed to assess, score, and classify the technical difficulty of common bile duct (CBD) stone removal during endoscopic retrograde cholangiopancreatography (ERCP). The efficacy of the CAD system was subsequently assessed through a multicenter, prospective, observational study. METHOD: All patients who met the inclusion criteria were included. Based on cholangiogram images, the CAD system analyzed the level of difficulty of stone removal and classified it into "difficult" and "easy" groups. Subsequently, differences in clinical endpoints, including attempts at stone extraction, stone extraction time, total operation time, and stone clearance rates were compared between the two groups. RESULTS: 173 patients with CBD stones from three hospitals were included in the study. The group classified as difficult by CAD had more extraction attempts (7.20 vs. 4.20, P < 0.001), more frequent machine lithotripsy (30.4 % vs. 7.1 %, P < 0.001), longer stone extraction time (16.59 vs. 7.69 minutes, P < 0.001), lower single-session stone clearance rate (73.9 % vs. 94.5 %, P < 0.001), and lower total stone clearance rate (89.1 % vs. 97.6 %, P = 0.019) compared with the group classified as easy by CAD. CONCLUSION: The CAD system effectively assessed and classified the degree of technical difficulty in endoscopic stone extraction during ERCP. In addition, it automatically provided a quantitative evaluation of CBD and stones, which in turn could help endoscopists to apply suitable procedures and interventional methods to minimize the possible risks associated with endoscopic stone removal.

Effect of an automated flexible endoscope channel brushing system on improving reprocessing quality: a randomized controlled study.

BACKGROUND: Qualified reprocessing, of which meticulous channel brushing is the most crucial step, is essential for prevention and control of endoscopy-associated infections. However, channel brushing is often omitted in practice. This study aimed to evaluate the effect of an automated flexible endoscope channel brushing system (AECBS) on improving the quality of endoscope reprocessing. METHODS: This prospective, randomized controlled study was conducted between 24 November 2021 and 22 January 2022 at Renmin Hospital of Wuhan University, China. Eligible endoscopes were randomly allocated to the auto group (channels brushed by AECBS) or the manual group (channels brushed manually), with sampling and culturing after high-level disinfection and drying. The primary end point was the proportion of endoscopes with positive cultures. RESULTS: 204 endoscopes in the auto group and 205 in the manual group were analyzed. The proportion of endoscopes with positive cultures was significantly lower in the auto group (15.2 % [95 %CI 10.7 %-21.0 %]) than in the manual group (23.4 % [95 %CI 17.9 %-29.9 %]). CONCLUSIONS: AECBS could effectively reduce bioburden and improve reprocessing quality of gastroscopes and colonoscopes. AECBS has the potential to replace manual brushing and lower the risk of endoscopy-associated infections, providing a new option for the optimization of reprocessing.

A deep-learning based system using multi-modal data for diagnosing gastric neoplasms in real-time (with video).

BACKGROUND: White light (WL) and weak-magnifying (WM) endoscopy are both important methods for diagnosing gastric neoplasms. This study constructed a deep-learning system named ENDOANGEL-MM (multi-modal) aimed at real-time diagnosing gastric neoplasms using WL and WM data. METHODS: WL and WM images of a same lesion were combined into image-pairs. A total of 4201 images, 7436 image-pairs, and 162 videos were used for model construction and validation. Models 1-5 including two single-modal models (WL, WM) and three multi-modal models (data fusion on task-level, feature-level, and input-level) were constructed. The models were tested on three levels including images, videos, and prospective patients. The best model was selected for constructing ENDOANGEL-MM. We compared the performance between the models and endoscopists and conducted a diagnostic study to explore the ENDOANGEL-MM's assistance ability. RESULTS: Model 4 (ENDOANGEL-MM) showed the best performance among five models. Model 2 performed better in single-modal models. The accuracy of ENDOANGEL-MM was higher than that of Model 2 in still images, real-time videos, and prospective patients. (86.54 vs 78.85%, P = 0.134; 90.00 vs 85.00%, P = 0.179; 93.55 vs 70.97%, P < 0.001). Model 2 and ENDOANGEL-MM outperformed endoscopists on WM data (85.00 vs 71.67%, P = 0.002) and multi-modal data (90.00 vs 76.17%, P = 0.002), significantly. With the assistance of ENDOANGEL-MM, the accuracy of non-experts improved significantly (85.75 vs 70.75%, P = 0.020), and performed no significant difference from experts (85.75 vs 89.00%, P = 0.159). CONCLUSIONS: The multi-modal model constructed by feature-level fusion showed the best performance. ENDOANGEL-MM identified gastric neoplasms with good accuracy and has a potential role in real-clinic.

Targeted labeling with tissue marking dyes guided by magnifying endoscopy of endoscopic submucosal dissection specimen improves the accuracy of endoscopic and histopathological diagnosis of early gastric cancer: a before-after study.

BACKGROUND: Although histopathological evaluation after endoscopic submucosal dissection (ESD) is critical to assess the accuracy of endoscopic diagnosis, it is still challenging to perform precise endoscopic to pathological evaluation. We evaluated the importance of tissue marking dye (TMD)-targeted marking for post-ESD specimen guided by magnificent endoscope on histopathological accuracy and endoscopic-to-histopathological reconstruction. STUDY DESIGN: A total of 81 specimens resected by ESD [43 without TMD marking (N-TMD group), and 38 specimens with TMD-targeted cancerous areas marking guided by post-procedural magnifying endoscopy on resected specimens (TMD group)] between January 31, 2019, and January 31, 2022 at the Renmin Hospital of Wuhan University were included in the study. The baseline characteristics of patients, discrepancies between endoscopic and histopathological diagnosis, and the impact of TMD on histopathological diagnosis and reconstruction were analyzed. RESULTS: Discrepancies between endoscopic (pre-ESD) and histopathological (post-ESD) diagnosis increased significantly in TMD group (68.4% (26/38) for tumor areas, 26.3% (10/38) for tumor margins, and 26.3% (10/38) for tumor differentiations) when compared with N-TMD group (p < 0.0001). Deeper sections were achieved in all TMD-marked resected lesions and 27.9% (12/43) lesions in the N-TMD group (p < 0.001). More pathological evaluations in TMD group were changed from curative resection to non-curative resection [6/38(15.8%) vs 1/43(2.3%)] compared with N-TMD group (p < 0.0001). TMD-targeted marking also improved the efficiency of histopathological reconstruction on pre-procedural endoscopic images and benefit endoscopists training. CONCLUSION: TMD-targeted labeling on resected specimens could improve precise endoscopic-to-pathological diagnosis, reconstruction by point-to-point marking and benefit endoscopists training.

Development and validation of an artificial intelligence-based system for predicting colorectal cancer invasion depth using multi-modal data.

OBJECTIVES: Accurate endoscopic optical prediction of the depth of cancer invasion is critical for guiding an optimal treatment approach of large sessile colorectal polyps but was hindered by insufficient endoscopists expertise and inter-observer variability. We aimed to construct a clinically applicable artificial intelligence (AI) system for the identification of presence of cancer invasion in large sessile colorectal polyps. METHODS: A deep learning-based colorectal cancer invasion calculation (CCIC) system was constructed. Multi-modal data including clinical information, white light (WL) and image-enhanced endoscopy (IEE) were included for training. The system was trained using 339 lesions and tested on 198 lesions across three hospitals. Man-machine contest, reader study and video validation were further conducted to evaluate the performance of CCIC. RESULTS: The overall accuracy of CCIC system using image and video validation was 90.4% and 89.7%, respectively. In comparison with 14 endoscopists, the accuracy of CCIC was comparable with expert endoscopists but superior to all the participating senior and junior endoscopists in both image and video validation set. With CCIC augmentation, the average accuracy of junior endoscopists improved significantly from 75.4% to 85.3% (P = 0.002). CONCLUSIONS: This deep learning-based CCIC system may play an important role in predicting the depth of cancer invasion in colorectal polyps, thus determining treatment strategies for these large sessile colorectal polyps.

Benefits and challenges in implementation of artificial intelligence in colonoscopy: World Endoscopy Organization position statement.

The number of artificial intelligence (AI) tools for colonoscopy on the market is increasing with supporting clinical evidence. Nevertheless, their implementation is not going smoothly for a variety of reasons, including lack of data on clinical benefits and cost-effectiveness, lack of trustworthy guidelines, uncertain indications, and cost for implementation. To address this issue and better guide practitioners, the World Endoscopy Organization (WEO) has provided its perspective about the status of AI in colonoscopy as the position statement. WEO Position Statement: Statement 1.1: Computer-aided detection (CADe) for colorectal polyps is likely to improve colonoscopy effectiveness by reducing adenoma miss rates and thus increase adenoma detection; Statement 1.2: In the short term, use of CADe is likely to increase health-care costs by detecting more adenomas; Statement 1.3: In the long term, the increased cost by CADe could be balanced by savings in costs related to cancer treatment (surgery, chemotherapy, palliative care) due to CADe-related cancer prevention; Statement 1.4: Health-care delivery systems and authorities should evaluate the cost-effectiveness of CADe to support its use in clinical practice; Statement 2.1: Computer-aided diagnosis (CADx) for diminutive polyps (≤5 mm), when it has sufficient accuracy, is expected to reduce health-care costs by reducing polypectomies, pathological examinations, or both; Statement 2.2: Health-care delivery systems and authorities should evaluate the cost-effectiveness of CADx to support its use in clinical practice; Statement 3: We recommend that a broad range of high-quality cost-effectiveness research should be undertaken to understand whether AI implementation benefits populations and societies in different health-care systems.

Real-time automated diagnosis of colorectal cancer invasion depth using a deep learning model with multimodal data (with video).

BACKGROUND AND AIMS: The optical diagnosis of colorectal cancer (CRC) invasion depth with white light (WL) and image-enhanced endoscopy (IEE) remains challenging. We aimed to construct and validate a 2-modal deep learning-based system, incorporated with both WL and IEE images (named Endo-CRC) in estimating the invasion depth of CRC. METHODS: Samples were retrospectively obtained from 3 hospitals in China. We combined WL and IEE images into image pairs. Altogether, 337,278 image pairs from 268 noninvasive and superficial CRC and 181,934 image pairs from 82 deep CRC were used for training. A total of 296,644 and 4528 image pairs were used for internal and external tests and for comparison with endoscopists. Thirty-five videos were used for evaluating the real-time performance of the Endo-CRC system. Two deep learning models, solely using either WL (model W) or IEE images (model I), were constructed to compare with Endo-CRC. RESULTS: The accuracies of Endo-CRC in internal image tests with and without advanced CRC were 91.61% and 93.78%, respectively, and 88.65% in the external test, which did not include advanced CRC. In an endoscopist-machine competition, Endo-CRC achieved an expert comparable accuracy of 88.11% and the highest sensitivity compared with all endoscopists. In a video test, Endo-CRC achieved an accuracy of 100.00%. Compared with model W and model I, Endo-CRC had a higher accuracy (per image pair: 91.61% vs 88.27% compared with model I and 91.61% vs 81.32% compared with model W). CONCLUSIONS: The Endo-CRC system has great potential for assisting in CRC invasion depth diagnosis and may be well applied in clinical practice.

Real-time use of artificial intelligence for diagnosing early gastric cancer by magnifying image-enhanced endoscopy: a multicenter diagnostic study (with videos).

BACKGROUND AND AIMS: Endoscopy is a pivotal method for detecting early gastric cancer (EGC). However, skill among endoscopists varies greatly. Here, we proposed a deep learning-based system named ENDOANGEL-ME to diagnose EGC in magnifying image-enhanced endoscopy (M-IEE). METHODS: M-IEE images were retrospectively obtained from 6 hospitals in China, including 4667 images for training and validation, 1324 images for internal tests, and 4702 images for external tests. One hundred eighty-seven stored videos from 2 hospitals were used to evaluate the performance of ENDOANGEL-ME and endoscopists and to assess the effect of ENDOANGEL-ME on improving the performance of endoscopists. Prospective consecutive patients undergoing M-IEE were enrolled from August 17, 2020 to August 2, 2021 in Renmin Hospital of Wuhan University to assess the applicability of ENDOANGEL-ME in clinical practice. RESULTS: A total of 3099 patients undergoing M-IEE were enrolled in this study. The diagnostic accuracy of ENDOANGEL-ME for diagnosing EGC was 88.44% and 90.49% in internal and external images, respectively. In 93 internal videos, ENDOANGEL-ME achieved an accuracy of 90.32% for diagnosing EGC, significantly superior to that of senior endoscopists (70.16% ± 8.78%). In 94 external videos, with the assistance of ENDOANGEL-ME, endoscopists showed improved accuracy and sensitivity (85.64% vs 80.32% and 82.03% vs 67.19%, respectively). In 194 prospective consecutive patients with 251 lesions, ENDOANGEL-ME achieved a sensitivity of 92.59% (25/27) and an accuracy of 83.67% (210/251) in real clinical practice. CONCLUSIONS: This multicenter diagnostic study showed that ENDOANGEL-ME can be well applied in the clinical setting. (Clinical trial registration number: ChiCTR2000035116.).