Assessment of colonoscopy skill using machine learning to measure quality: Proof-of-concept and initial validation.

Background and study aims Low-quality colonoscopy increases cancer risk but measuring quality remains challenging. We developed an automated, interactive assessment of colonoscopy quality (AI-CQ) using machine learning (ML). Methods Based on quality guidelines, metrics selected for AI development included insertion time (IT), withdrawal time (WT), polyp detection rate (PDR), and polyps per colonoscopy (PPC). Two novel metrics were also developed: HQ-WT (time during withdrawal with clear image) and WT-PT (withdrawal time subtracting polypectomy time). The model was pre-trained using a self-supervised vision transformer on unlabeled colonoscopy images and then finetuned for multi-label classification on another mutually exclusive colonoscopy image dataset. A timeline of video predictions and metric calculations were presented to clinicians in addition to the raw video using a web-based application. The model was externally validated using 50 colonoscopies at a second hospital. Results The AI-CQ accuracy to identify cecal intubation was 88%. IT ( P = 0.99) and WT ( P = 0.99) were highly correlated between manual and AI-CQ measurements with a median difference of 1.5 seconds and 4.5 seconds, respectively. AI-CQ PDR did not significantly differ from manual PDR (47.6% versus 45.5%, P = 0.66). Retroflexion was correctly identified in 95.2% and number of right colon evaluations in 100% of colonoscopies. HQ-WT was 45.9% of, and significantly correlated with ( P = 0.85) WT time. Conclusions An interactive AI assessment of colonoscopy skill can automatically assess quality. We propose that this tool can be utilized to rapidly identify and train providers in need of remediation.

Safety and feasibility of establishing an adjuvant hepatic artery infusion program.

BACKGROUND: Hepatic artery infusion (HAI) is less frequently used in the adjuvant setting for resectable colorectal liver metastasis (CRLM) due to concerns regarding toxicity. Our objective was to evaluate the safety and feasibility of establishing an adjuvant HAI program. METHODS: Patients who underwent HAI pump placement between January 2019 and February 2023 for CRLM were identified. Complications and HAI delivery were compared between patients who received HAI in the unresectable and adjuvant settings. RESULTS: Of 51 patients, 23 received HAI for unresectable CRLM and 28 in the adjuvant setting. Patients with unresectable CRLM more commonly had bilobar disease (n = 23/23 vs n = 18/28, p < 0.01) and more preoperative liver metastases (median 10 [IQR 6-15] vs 4 [IQR 3-7], p < 0.01). Biliary sclerosis was the most common complication (n = 2/23 vs n = 4/28); however, there were no differences in postoperative or HAI-specific complications. In the most recent two years, 0 patients in the unresectable group vs 2 patients in the adjuvant group developed biliary sclerosis. All patients were initiated on HAI with no difference in treatment times or dose reductions. CONCLUSION: Adjuvant HAI is safe and feasible for patients with resectable CRLM. HAI programs can carefully consider including patients with resectable CRLM if managed by an experienced multidisciplinary team with quality assurance controls in place.

Effect of an online educational module incorporating real-time feedback on accuracy of polyp sizing in trainees: a randomized controlled trial.

BACKGROUND: Although polyp size dictates surveillance intervals, endoscopists often estimate polyp size inaccurately. We hypothesized that an intervention providing didactic instruction and real-time feedback could significantly improve polyp size classification. METHODS: We conducted a multicenter randomized controlled trial to evaluate the impact of different components of an online educational module on polyp sizing. Participants were randomized to control (no video, no feedback), video only, feedback only, or video + feedback. The primary outcome was accuracy of polyp size classification into clinically relevant categories (diminutive [1-5mm], small [6-9mm], large [≥10mm]). Secondary outcomes included accuracy of exact polyp size (inmm), learning curves, and directionality of inaccuracy (over- vs. underestimation). RESULTS: 36 trainees from five training programs provided 1360 polyp size assessments. The feedback only (80.1%, P=0.01) and video + feedback (78.9%, P=0.02) groups had higher accuracy of polyp size classification compared with controls (71.6%). There was no significant difference in accuracy between the video only group (74.4%) and controls (P=0.42). Groups receiving feedback had higher accuracy of exact polyp size (inmm) and higher peak learning curves. Polyps were more likely to be overestimated than underestimated, and 29.3% of size inaccuracies impacted recommended surveillance intervals. CONCLUSIONS: Our online educational module significantly improved polyp size classification. Real-time feedback appeared to be a critical component in improving accuracy. This scalable and no-cost educational module could significantly decrease under- and overutilization of colonoscopy, improving patient outcomes while increasing colonoscopy access.

Adherence to quality indicators and best practices in surveillance endoscopy of Barrett's esophagus: A video-based assessment.

Background and study aims Adherence to quality indicators (QIs) and best practices (BPs) for endoscopic surveillance of Barrett's esophagus (BE) is low based on clinical documentation which is an inaccurate representation of events occurring during procedures. This study aimed to assess adherence to measurable QI and BP using video evaluation. Methods We performed a single center video-based retrospective review of surveillance endoscopies performed for BE ≥1 cm between March 1, 2018 and October 1, 2020. Adherence to QIs and BPs was assessed through video review and documentation. Videos were evaluated by five gastroenterologists. Interrater variability was determined using 10 videos before reviewing the remaining 128 videos. A generalized linear regression model was used to determine predictors of adherence to QIs and BPs. Results There were 138 endoscopies reviewed. Inspection with virtual chromoendoscopy (VC) occurred in 75 cases (54%) on video review with documentation in 50 of these cases (67%). Adherence to the Seattle protocol (SP) occurred in 74 cases (54%) on video review with documentation in 28 of these cases (38%). Use of VC or the SP was documented but not observed on video review in 16 (12%) and 30 (22%) cases, respectively. Length of BE was associated with increased use of the Prague classification (odds ratio [OR] 1.21, 95% confidence interval [CI] 1.07-1.37) while years in practice was associated with a decreased likelihood of VC use (OR 0.93, 95% CI 0.88-0.99). Conclusions This study validates prior data demonstrating poor adherence to QIs and BPs and highlights discrepancies between clinical documentation and events occurring during procedures.

Effect of Polypectomy Simulation-Based Mastery Learning on Skill Retention Among Practicing Endoscopists.

PURPOSE: Practicing endoscopists frequently perform and teach screening colonoscopies and polypectomies, but there is no standardized method to train and assess physicians who perform polypectomy procedures. The authors created a polypectomy simulation-based mastery learning (SBML) curriculum and hypothesized that completion of the curriculum would lead to immediate improvement in polypectomy skills and skill retention at 6 and 12 months after training. METHOD: The authors performed a pretest-posttest cohort study with endoscopists who completed SBML and were randomized to follow-up at 6 or 12 months from May 2021 to August 2022. Participants underwent SBML training, including a pretest, a video lecture, deliberate practice, and a posttest. All learners were required to meet or exceed a minimum passing standard on a 17-item skills checklist before completing training and were randomized to follow-up at 6 or 12 months. The authors compared simulated polypectomy skills performance on the checklist from pretest to posttest and posttest to 6- or 12-month follow-up test. RESULTS: Twenty-four of 30 eligible participants (80.0%) completed the SBML intervention, and 20 of 24 (83.3%) completed follow-up testing. The minimum passing standard was set at 93% of checklist items correct. The pretest passing rate was 4 of 24 participants (16.7%) compared with 24 of 24 participants (100%) at posttest ( P < .001). There were no significant differences in passing rates from posttest to combined 6- and 12-month posttest in which 18 of 20 participants (90.0%) passed. CONCLUSIONS: Before training and despite years of clinical experience, practicing endoscopists demonstrated poor performance of polypectomy skills. SBML was an effective method for practicing endoscopists to acquire and maintain polypectomy skills during a 6- to 12-month period.

Varied Trainee Competence in Cold Snare Polypectomy: Results of the COMPLETE Randomized Controlled Trial.

INTRODUCTION: Cold snare polypectomy (CSP) is strongly recommended as the optimal technique for the complete removal of small polyps. Though significant variability in polypectomy technique and quality has been established, the learning curve and impact of targeted training on CSP are unknown. Video feedback has shown promise as an effective pedagogy to improve performance among surgical trainees. We aimed to compare CSP performance between trainees who received video-based feedback and those who received conventional apprentice-based concurrent feedback. We hypothesized that video-based feedback would accelerate competence. METHODS: We conducted a single-blinded, randomized controlled trial on competence for CSP of polyps <1 cm, comparing video-based feedback with conventional feedback. We randomly assigned deidentified consecutively recorded CSP videos to blinded raters to assess using the CSP Assessment Tool. We shared cumulative sum learning curves every 25 CSP with each trainee. The video feedback trainees also received biweekly individualized terminal feedback. Control trainees received conventional feedback during colonoscopy. The primary outcome was CSP competence. We also assessed competence across domains and change over polypectomy volume. RESULTS: We enrolled and randomized 22 trainees, 12 to video-based feedback and 10 to conventional feedback, and evaluated 2,339 CSP. The learning curve was long; 2 trainees (16.7%) in the video feedback achieved competence, after a mean of 135 polyps, and no one in the control ( P = 0.481) achieved competence. Overall and in all steps of CSP, a higher percentage of the video feedback group met competence, increasing 3% every 20 CSP ( P = 0.0004). DISCUSSION: Video feedback aided trainees to competence in CSP. However, the learning curve was long. Our findings strongly suggest that current training methods are not sufficient to support trainees to competency by the completion of their fellowship programs. The impact of new training methods, such as simulation-based mastery learning, should be assessed to determine whether such methods can result in achievement of competence at a faster rate; ClinicalTrials.gov : NCT03115008.

Esophageal and Esophagogastric Junction Cancers, Version 2.2023, NCCN Clinical Practice Guidelines in Oncology.

Cancers originating in the esophagus or esophagogastric junction constitute a major global health problem. Esophageal cancers are histologically classified as squamous cell carcinoma (SCC) or adenocarcinoma, which differ in their etiology, pathology, tumor location, therapeutics, and prognosis. In contrast to esophageal adenocarcinoma, which usually affects the lower esophagus, esophageal SCC is more likely to localize at or higher than the tracheal bifurcation. Systemic therapy can provide palliation, improved survival, and enhanced quality of life in patients with locally advanced or metastatic disease. The implementation of biomarker testing, especially analysis of HER2 status, microsatellite instability status, and the expression of programmed death-ligand 1, has had a significant impact on clinical practice and patient care. Targeted therapies including trastuzumab, nivolumab, ipilimumab, and pembrolizumab have produced encouraging results in clinical trials for the treatment of patients with locally advanced or metastatic disease. Palliative management, which may include systemic therapy, chemoradiation, and/or best supportive care, is recommended for all patients with unresectable or metastatic cancer. Multidisciplinary team management is essential for all patients with locally advanced esophageal or esophagogastric junction cancers. This selection from the NCCN Guidelines for Esophageal and Esophagogastric Junction Cancers focuses on the management of recurrent or metastatic disease.

Percutaneous Cystic Duct Interventions and Drain Internalization for Calculous Cholecystitis in Patients Ineligible for Surgery.

PURPOSE: To evaluate the feasibility, effectiveness, and outcomes of percutaneous cholecystostomy drain internalization in patients with calculous cholecystitis who were not surgical candidates. MATERIALS AND METHODS: Percutaneous cystic duct interventions were attempted in 17 patients (with the intent to place dual cholecystoduodenal stents) who were deemed unfit for surgery and had previously undergone percutaneous cholecystostomies for acute calculous cholecystitis. Baseline demographics, technical success, time from percutaneous cholecystostomy to internalization (dual cholecystoduodenal stent placement), stent patency duration, and adverse event rates were evaluated. RESULTS: Fifteen (88%) of 17 procedures to cross the cystic duct were technically successful. Of these 17 patients, 13 (76%) underwent successful placement of dual cholecystoduodenal stents. Two of these 13 patients (who had successful dual cholecystoduodenal stent placement) needed repeat percutaneous cholecystostomy drains (1 patient had stent migration leading to recurrent cholecystitis, and the other had a perihepatic biloma). The 1-year patency rate was 77% (95% CI, 47%-100%). CONCLUSIONS: Dual cholecystoduodenal stent placement in nonsurgical patients is a technically feasible treatment option with the goal to remove percutaneous cholecystostomy drains.

Radiomics Boosts Deep Learning Model for IPMN Classification.

Intraductal Papillary Mucinous Neoplasm (IPMN) cysts are pre-malignant pancreas lesions, and they can progress into pancreatic cancer. Therefore, detecting and stratifying their risk level is of ultimate importance for effective treatment planning and disease control. However, this is a highly challenging task because of the diverse and irregular shape, texture, and size of the IPMN cysts as well as the pancreas. In this study, we propose a novel computer-aided diagnosis pipeline for IPMN risk classification from multi-contrast MRI scans. Our proposed analysis framework includes an efficient volumetric self-adapting segmentation strategy for pancreas delineation, followed by a newly designed deep learning-based classification scheme with a radiomics-based predictive approach. We test our proposed decision-fusion model in multi-center data sets of 246 multi-contrast MRI scans and obtain superior performance to the state of the art (SOTA) in this field. Our ablation studies demonstrate the significance of both radiomics and deep learning modules for achieving the new SOTA performance compared to international guidelines and published studies (81.9% vs 61.3% in accuracy). Our findings have important implications for clinical decision-making. In a series of rigorous experiments on multi-center data sets (246 MRI scans from five centers), we achieved unprecedented performance (81.9% accuracy). The code is available upon publication.

Interventions to improve the performance of upper GI endoscopy quality indicators.

The promotion of quality and best practices in gastroenterology and endoscopy is an ongoing effort. For upper GI endoscopy, quality indicators derived from clinical studies and expert consensus have been long established but remain variably obtained. To date, data on interventions aimed to improve these indicators are scarce. We systematically reviewed the literature to identify interventions and measures demonstrated to improve the performance of previously established upper endoscopy quality indicators. We also identified evidence gaps and opportunities for improvement in this area.

Quality Indicators for the Detection and Removal of Colorectal Polyps and Interventions to Improve Them.

Modifiable risk factors for postcolonoscopy colorectal cancer include suboptimal lesion detection (missed neoplasms) and inadequate lesion removal (incomplete polypectomy) during colonoscopy. Competent detection and removal of colorectal polyps are thus fundamental to ensuring adequate colonoscopy quality. Several well-researched quality metrics for polyp detection have been implemented into clinical practice, chief among these the adenoma detection rate. Less data are available on quality indicators for polyp removal, which currently include complete resection rates and skills assessment tools. This review summarizes the available literature on quality indicators for the detection and removal of colorectal polyps, as well as interventions to improve them.

Individualized feedback on colonoscopy skills improves group colonoscopy quality in providers with lower adenoma detection rates.

Background and study aims Colonoscopy inspection quality (CIQ) assesses skills (fold examination, cleaning, and luminal distension) during inspection for polyps and correlates with adenoma detection rate (ADR) and serrated detection rate (SDR). We aimed to determine whether providing individualized CIQ feedback with instructional videos improves quality metrics performance. Methods We prospectively studied 16 colonoscopists who already received semiannual benchmarked reports of quality metrics (ADR, SDR, and withdrawal time [WT]). We randomly selected seven colonoscopies/colonoscopist for evaluation. Six gastroenterologists graded CIQ using an established scale. We created instructional videos demonstrating optimal and poor inspection techniques. Colonoscopists received the instructional videos and benchmarked CIQ performance. We compared ADR, SDR, and WT in the 12 months preceding ("baseline") and following CIQ feedback. Colonoscopists were stratified by baseline ADR into lower (≤ 34 %) and higher-performing (> 34 %) groups. Results Baseline ADR was 38.5 % (range 26.8 %-53.8 %) and SDR was 11.2 % (2.8 %-24.3 %). The proportion of colonoscopies performed by lower-performing colonoscopists was unchanged from baseline to post-CIQ feedback. All colonoscopists reviewed their CIQ report cards. Post-feedback, ADR (40.1 % vs 38.5 %, P  = 0.1) and SDR (12.2 % vs. 11.2 %, P  = 0.1) did not significantly improve; WT significantly increased (11.4 vs 12.4 min, P  < 0.01). Among the eight lower-performing colonoscopists, group ADR (31.1 % vs 34.3 %, P  = 0.02) and SDR (7.2 % vs 9.1 %, P  = 0.02) significantly increased post-feedback. In higher-performing colonoscopists, ADR and SDR did not change. Conclusions CIQ feedback modestly improves ADR and SDR among colonoscopists with lower baseline ADR but has no effect on higher-performing colonoscopists. Individualized feedback on colonoscopy skills could be used to improve polyp detection by lower-performing colonoscopists.

Gastric Cancer, Version 2.2022, NCCN Clinical Practice Guidelines in Oncology.

Gastric cancer is the third leading cause of cancer-related deaths worldwide. Over 95% of gastric cancers are adenocarcinomas, which are typically classified based on anatomic location and histologic type. Gastric cancer generally carries a poor prognosis because it is often diagnosed at an advanced stage. Systemic therapy can provide palliation, improved survival, and enhanced quality of life in patients with locally advanced or metastatic disease. The implementation of biomarker testing, especially analysis of HER2 status, microsatellite instability (MSI) status, and the expression of programmed death-ligand 1 (PD-L1), has had a significant impact on clinical practice and patient care. Targeted therapies including trastuzumab, nivolumab, and pembrolizumab have produced encouraging results in clinical trials for the treatment of patients with locally advanced or metastatic disease. Palliative management, which may include systemic therapy, chemoradiation, and/or best supportive care, is recommended for all patients with unresectable or metastatic cancer. Multidisciplinary team management is essential for all patients with localized gastric cancer. This selection from the NCCN Guidelines for Gastric Cancer focuses on the management of unresectable locally advanced, recurrent, or metastatic disease.

Percutaneous Biliary Neo-anastomosis or Neo-duct Creation Using Radiofrequency Wires.

BACKGROUND AND OBJECTIVE: This study aims to report a minimally invasive, percutaneous technique to cross complete biliary occlusions using a radiofrequency wire to create a biliary-enteric neo-anastomosis or biliary neo-duct. METHODS: All patients who underwent attempted creation of a neo-anastomosis/neo-duct using an RF wire were included in the study. Patients with non-malignant, complete and non-traversable biliary occlusion were considered for the creation of a neo-anastomosis (4 patients)/neo-duct (1 patient). RESULTS: Five patients (4 females, 1 male) with a mean age of 40 years (range: 10-69 years) were included in this study. Percutaneous bowel access was obtained in three of five patients and a snare was placed in the jejunal loop to serve as a target for RF wire advancement. In two patients, an enteral target was provided using a peroral endoscope in collaboration with gastroenterology. The procedure was technically successful in all cases and no intra-operative complications occurred. Patency of the neo-anastomosis was maintained in all patients, with follow-up ranging from 4 to 11 months. CONCLUSION: The RF wire was successfully used to create a biliary neo-anastomosis with a minimally invasive approach for the treatment of non-malignant complete biliary occlusion. This technique offers patients with complete biliary occlusion a safe, effective and durable treatment option which avoids the need for a permanent biliary drain and ultimately results in an improved quality of life.

Pancreatic Cystic Lesions and Malignancy: Assessment, Guidelines, and the Field Defect.

The widespread use of high-spatial-resolution cross-sectional imaging has led to an increase in detection of incidental pancreatic cystic lesions. These lesions are a diverse group, ranging from indolent and premalignant lesions to invasive cancers. The diagnosis of several of these lesions can be suggested on the basis of their imaging appearance, while many other lesions require follow-up imaging and/or aspiration. The smaller cystic lesions, often branch-duct intraductal papillary mucinous neoplasms, have overlapping imaging characteristics that make diagnostic assessment of the natural history and malignancy risk confusing. Expert panels have developed societal guidelines, based on a consensus, for surveillance of these lesions. However, these guidelines are often inconsistent and are constantly evolving as additional scientific data are accumulated. Identification of features associated with increased risk of malignancy is important for proper management. The concept of field defect, whereby pancreatic adenocarcinoma develops at a site different from the site of the pancreatic cyst, adds to the complexity of screening guidelines. As a result of the differences in guidelines, key stakeholders (eg, radiologists, gastroenterologists, and surgeons) must review and come to a consensus regarding which guideline, or combination of guidelines, to follow at their individual institutions. Standardized reporting and macros are helpful for ensuring the uniformity of interpretations. Radiologists play a critical role in the detection and characterization of pancreatic cystic lesions, in the follow-up recommendations for these lesions, and in the detection of associated cancer. An invited commentary by Zaheer is available online. Online supplemental material is available for this article. ©RSNA, 2021.

Bariatric Bypass Surgery Is a Risk Factor for Incomplete Colonoscopy Preparation.

OBJECTIVES: Effective colon cancer screening requires adequate bowel preparation. Anecdotal evidence has suggested that patients with a history of bariatric surgery are more likely to have inadequate preparation. This study aims to evaluate the role of bariatric surgery as a predictive risk factor for inadequate bowel preparation. METHODS: Data were collected retrospectively for consecutive colonoscopies between March 1, 2013, and November 15, 2017. Only the index colonoscopy for each patient within the review period, and those scored using the Boston Bowel Preparation Scale (BBPS) were included. Inadequate preparation was defined as any one or more colon segments with a BBPS score of less than two, and patients with a history of bariatric surgery were identified using ICD 9/10 codes. Multivariate logistic regression and propensity score matching was used to assess for independent factors predictive of inadequate bowel preparation. RESULTS: A total of 25,318 colonoscopies were included in the analysis. Two hundred 278 (1.1%) patients had a history of bariatric surgery, among which 171 (61.5%) had a history of bypass surgery and 107 (38.5%) had a history of restrictive surgical procedure. A history of bariatric surgery was predictive of inadequate bowel preparation in both univariate (OR: 2.87, 95% CI: 1.92-4.29, P = 0.0003) and multivariate analysis (OR: 2.16, 95% CI: 1.43-3.27, P = 0.0003) after controlling for differences in baseline characteristics. When evaluated separately, a history of bypass surgery was associated with inadequate bowel preparation (aOR: 2.96, 95% CI: 1.86-4.72, P < 0.0001), whereas a history of a restrictive bariatric surgery was not associated with inadequate bowel preparation in multivariate analysis (aOR: 0.98, 95% CI: 0.4-2.45, P = 0.971). CONCLUSIONS: A history of bariatric surgery is an independent risk factor for inadequate bowel preparation. Furthermore, bypass bariatric surgeries had higher rates of inadequate preparation when compared to restrictive bariatric surgeries. Further quality improvement initiatives should be directed at identifying the appropriate bowel preparation regimen in this population.

The quality of screening colonoscopy in rural and underserved areas.

BACKGROUND: Screening colonoscopy effectiveness depends on procedure quality; however, knowledge about colonoscopy quality in rural and underserved areas is limited. This study aimed to describe the characteristics and quality of colonoscopy and to examine predictors of colonoscopy quality at rural and underserved hospitals. METHODS: Adults undergoing colonoscopy from April 2017 to March 2019 at rural or underserved hospitals across the Illinois Surgical Quality Improvement Collaborative were prospectively identified. The primary outcome was colorectal adenoma detection, and secondary outcomes included bowel preparation adequacy, cecum photodocumentation, and withdrawal time. Performance was benchmarked against multisociety guidelines, and multivariable logistic regression was used to examine patient, physician, and procedure characteristics associated with adenoma detection. RESULTS: In total, 4217 colonoscopy procedures were performed at 8 hospitals, including 1865 screening examinations performed by 19 surgeons, 9 gastroenterologists, and 2 family practitioners. Physician screening volume ranged from 2 to 218 procedures (median 50; IQR 23-74). Adenoma detection occurred in 26.6% of screening procedures (target: ≥ 25%), 90.7% had adequate bowel preparation (target: ≥ 85%), 93.1% had cecum photodocumentation (target: ≥ 95%), and mean withdrawal time was 8.1 min (target: ≥ 6). Physician specialty was associated with adenoma detection (gastroenterologists: 36.9% vs. surgeons: 22.5%; OR 2.30, 95% CI 1.40-3.77), but adequate bowel preparation (OR 1.15, 95% CI 0.76-1.73) and cecum photodocumentation (OR 1.56, 95% CI 0.91-2.69) were not. CONCLUSION: Colonoscopies performed at rural and underserved hospitals meet many quality metrics; however, quality varied widely. As physicians are scarce in rural and underserved areas, individualized interventions to improve colonoscopy quality are needed.