Influence of artificial intelligence on the diagnostic performance of endoscopists in the assessment of Barrett's esophagus: a tandem randomized and video trial.

BACKGROUND: This study evaluated the effect of an artificial intelligence (AI)-based clinical decision support system on the performance and diagnostic confidence of endoscopists in their assessment of Barrett's esophagus (BE). METHODS: 96 standardized endoscopy videos were assessed by 22 endoscopists with varying degrees of BE experience from 12 centers. Assessment was randomized into two video sets: group A (review first without AI and second with AI) and group B (review first with AI and second without AI). Endoscopists were required to evaluate each video for the presence of Barrett's esophagus-related neoplasia (BERN) and then decide on a spot for a targeted biopsy. After the second assessment, they were allowed to change their clinical decision and confidence level. RESULTS: AI had a stand-alone sensitivity, specificity, and accuracy of 92.2%, 68.9%, and 81.3%, respectively. Without AI, BE experts had an overall sensitivity, specificity, and accuracy of 83.3%, 58.1%, and 71.5%, respectively. With AI, BE nonexperts showed a significant improvement in sensitivity and specificity when videos were assessed a second time with AI (sensitivity 69.8% [95%CI 65.2%-74.2%] to 78.0% [95%CI 74.0%-82.0%]; specificity 67.3% [95%CI 62.5%-72.2%] to 72.7% [95%CI 68.2%-77.3%]). In addition, the diagnostic confidence of BE nonexperts improved significantly with AI. CONCLUSION: BE nonexperts benefitted significantly from additional AI. BE experts and nonexperts remained significantly below the stand-alone performance of AI, suggesting that there may be other factors influencing endoscopists' decisions to follow or discard AI advice.

AGA White Paper: Challenges and Gaps in Innovation for the Performance of Colonoscopy for Screening and Surveillance of Colorectal Cancer.

In 2018, the American Gastroenterological Association's Center for GI Innovation and Technology convened a consensus conference, entitled "Colorectal Cancer Screening and Surveillance: Role of Emerging Technology and Innovation to Improve Outcomes." The conference participants, which included more than 60 experts in colorectal cancer, considered recent improvements in colorectal cancer screening rates and polyp detection, persistent barriers to colonoscopy uptake, and opportunities for performance improvement and innovation. This white paper originates from that conference. It aims to summarize current patient- and physician-centered gaps and challenges in colonoscopy, diagnostic and therapeutic challenges affecting colonoscopy uptake, and the potential use of emerging technologies and quality metrics to improve patient outcomes.

Endoscopic prediction of submucosal invasion in Barrett's cancer with the use of artificial intelligence: a pilot study.

BACKGROUND: The accurate differentiation between T1a and T1b Barrett's-related cancer has both therapeutic and prognostic implications but is challenging even for experienced physicians. We trained an artificial intelligence (AI) system on the basis of deep artificial neural networks (deep learning) to differentiate between T1a and T1b Barrett's cancer on white-light images. METHODS: Endoscopic images from three tertiary care centers in Germany were collected retrospectively. A deep learning system was trained and tested using the principles of cross validation. A total of 230 white-light endoscopic images (108 T1a and 122 T1b) were evaluated using the AI system. For comparison, the images were also classified by experts specialized in endoscopic diagnosis and treatment of Barrett's cancer. RESULTS: The sensitivity, specificity, F1 score, and accuracy of the AI system in the differentiation between T1a and T1b cancer lesions was 0.77, 0.64, 0.74, and 0.71, respectively. There was no statistically significant difference between the performance of the AI system and that of experts, who showed sensitivity, specificity, F1, and accuracy of 0.63, 0.78, 0.67, and 0.70, respectively. CONCLUSION: This pilot study demonstrates the first multicenter application of an AI-based system in the prediction of submucosal invasion in endoscopic images of Barrett's cancer. AI scored equally to international experts in the field, but more work is necessary to improve the system and apply it to video sequences and real-life settings. Nevertheless, the correct prediction of submucosal invasion in Barrett's cancer remains challenging for both experts and AI.

Establishing key research questions for the implementation of artificial intelligence in colonoscopy: a modified Delphi method.

BACKGROUND : Artificial intelligence (AI) research in colonoscopy is progressing rapidly but widespread clinical implementation is not yet a reality. We aimed to identify the top implementation research priorities. METHODS : An established modified Delphi approach for research priority setting was used. Fifteen international experts, including endoscopists and translational computer scientists/engineers, from nine countries participated in an online survey over 9 months. Questions related to AI implementation in colonoscopy were generated as a long-list in the first round, and then scored in two subsequent rounds to identify the top 10 research questions. RESULTS : The top 10 ranked questions were categorized into five themes. Theme 1: clinical trial design/end points (4 questions), related to optimum trial designs for polyp detection and characterization, determining the optimal end points for evaluation of AI, and demonstrating impact on interval cancer rates. Theme 2: technological developments (3 questions), including improving detection of more challenging and advanced lesions, reduction of false-positive rates, and minimizing latency. Theme 3: clinical adoption/integration (1 question), concerning the effective combination of detection and characterization into one workflow. Theme 4: data access/annotation (1 question), concerning more efficient or automated data annotation methods to reduce the burden on human experts. Theme 5: regulatory approval (1 question), related to making regulatory approval processes more efficient. CONCLUSIONS : This is the first reported international research priority setting exercise for AI in colonoscopy. The study findings should be used as a framework to guide future research with key stakeholders to accelerate the clinical implementation of AI in endoscopy.

Artificial intelligence and deep learning for small bowel capsule endoscopy.

Capsule endoscopy is ideally suited to artificial intelligence-based interpretation given its reliance on pattern recognition in still images. Time saving viewing modes and lesion detection features currently available rely on machine learning algorithms, a form of artificial intelligence. Current software necessitates close human supervision given poor sensitivity relative to an expert reader. However, with the advent of deep learning, artificial intelligence is becoming increasingly reliable and will be increasingly relied upon. We review the major advances in artificial intelligence for capsule endoscopy in recent publications and briefly review artificial intelligence development for historical understanding. Importantly, recent advancements in artificial intelligence have not yet been incorporated into practice and it is immature to judge the potential of this technology based on current platforms. Remaining regulatory and standardization hurdles are being overcome and artificial intelligence-based clinical applications are likely to proliferate rapidly.

A primer on artificial intelligence and its application to endoscopy.

Artificial intelligence (AI) has emerged as a powerful and exciting new technology poised to impact many aspects of health care. In endoscopy, AI is now being used to detect and characterize benign and malignant GI lesions and assess malignant lesion depth of invasion. It will undoubtedly also find use in capsule endoscopy and inflammatory bowel disease. Herein, we provide the general endoscopist with a brief overview of AI and its emerging uses in our field. We also touch on the challenges of incorporating AI into clinical practice, such as workflow integration, data storage, and data privacy.

Real-time differentiation of adenomatous and hyperplastic diminutive colorectal polyps during analysis of unaltered videos of standard colonoscopy using a deep learning model.

BACKGROUND: In general, academic but not community endoscopists have demonstrated adequate endoscopic differentiation accuracy to make the 'resect and discard' paradigm for diminutive colorectal polyps workable. Computer analysis of video could potentially eliminate the obstacle of interobserver variability in endoscopic polyp interpretation and enable widespread acceptance of 'resect and discard'. STUDY DESIGN AND METHODS: We developed an artificial intelligence (AI) model for real-time assessment of endoscopic video images of colorectal polyps. A deep convolutional neural network model was used. Only narrow band imaging video frames were used, split equally between relevant multiclasses. Unaltered videos from routine exams not specifically designed or adapted for AI classification were used to train and validate the model. The model was tested on a separate series of 125 videos of consecutively encountered diminutive polyps that were proven to be adenomas or hyperplastic polyps. RESULTS: The AI model works with a confidence mechanism and did not generate sufficient confidence to predict the histology of 19 polyps in the test set, representing 15% of the polyps. For the remaining 106 diminutive polyps, the accuracy of the model was 94% (95% CI 86% to 97%), the sensitivity for identification of adenomas was 98% (95% CI 92% to 100%), specificity was 83% (95% CI 67% to 93%), negative predictive value 97% and positive predictive value 90%. CONCLUSIONS: An AI model trained on endoscopic video can differentiate diminutive adenomas from hyperplastic polyps with high accuracy. Additional study of this programme in a live patient clinical trial setting to address resect and discard is planned.

Response to endoscopic therapy for biliary anastomotic strictures in deceased versus living donor liver transplantation.

BACKGROUND: Endoscopic therapy has been successful in the management of biliary complications after both deceased donor liver transplantation (DDLT) and living donor liver transplantation (LDLT). LDLT is thought to be associated with higher rates of biliary complications, but there are few studies comparing the success of endoscopic management of anastomotic strictures between the two groups. This study aims to compare our experience in the endoscopic management of anastomotic strictures in DDLT versus LDLT. METHODS: This is a retrospective database review of all liver transplant patients undergoing endoscopic retrograde cholangiopancreatography (ERCP) after liver transplantation. The frequency of anastomotic stricture and the time to develop and to resolve anastomotic stricture were compared between DDLT and LDLT. The response of anastomotic stricture to endoscopic therapy was also analyzed. RESULTS: A total of 362 patients underwent liver transplantation between 2003 and 2011, with 125 requiring ERCP to manage biliary complications. Thirty-three (9.9%) cases of DDLT and 8 (27.6%) of LDLT (P=0.01) were found to have anastomotic stricture. When comparing DDLT and LDLT, there was no difference in the mean time to the development of anastomotic strictures (98+/-17 vs 172+/-65 days, P=0.11), likelihood of response to ERCP [22 (66.7%) vs 6 (75.0%), P=0.69], mean time to the resolution of anastomotic strictures (268+/-77 vs 125+/-37 days, P=0.34), and the number of ERCPs required to achieve resolution (3.9+/-0.4 vs 4.7+/-0.9, P=0.38). CONCLUSIONS: Endoscopic therapy is effective in the majority of biliary complications relating to liver transplantation. Anastomotic strictures occur more frequently in LDLT compared with DDLT, with equivalent endoscopic treatment response and outcomes for both groups.

Artificial intelligence in endoscopy: Overview, applications, and future directions.

Since the emergence of artificial intelligence (AI) in medicine, endoscopy applications in gastroenterology have been at the forefront of innovations. The ever-increasing number of studies necessitates the need to organize and classify applications in a useful way. Separating AI capabilities by computer aided detection (CADe), diagnosis (CADx), and quality assessment (CADq) allows for a systematic evaluation of each application. CADe studies have shown promise in accurate detection of esophageal, gastric and colonic neoplasia as well as identifying sources of bleeding and Crohn's disease in the small bowel. While more advanced CADx applications employ optical biopsies to give further information to characterize neoplasia and grade inflammatory disease, diverse CADq applications ensure quality and increase the efficiency of procedures. Future applications show promise in advanced therapeutic modalities and integrated systems that provide multimodal capabilities. AI is set to revolutionize clinical decision making and performance of endoscopy.

Artificial Intelligence in Inflammatory Bowel Disease Endoscopy: Implications for Clinical Trials.

Artificial intelligence shows promise for clinical research in inflammatory bowel disease endoscopy. Accurate assessment of endoscopic activity is important in clinical practice and inflammatory bowel disease clinical trials. Emerging artificial intelligence technologies can increase efficiency and accuracy of assessing the baseline endoscopic appearance in patients with inflammatory bowel disease and the impact that therapeutic interventions may have on mucosal healing in both of these contexts. In this review, state-of-the-art endoscopic assessment of mucosal disease activity in inflammatory bowel disease clinical trials is described, covering the potential for artificial intelligence to transform the current paradigm, its limitations, and suggested next steps. Site-based artificial intelligence quality evaluation and inclusion of patients in clinical trials without the need for a central reader is proposed; for following patient progress, a second reading using AI alongside a central reader with expedited reading is proposed. Artificial intelligence will support precision endoscopy in inflammatory bowel disease and is on the threshold of advancing inflammatory bowel disease clinical trial recruitment.