Correction to: Direct observation of procedural skills (DOPS) assessment in diagnostic gastroscopy: nationwide evidence of validity and competency development during training.

The citation for Reference 22 should be replaced with: Kumar NL, Kugener G, Perencevich ML, et al (2018) The SAFE-T assessment tool: derivation and validation of a web-based application for point-of-care evaluation of gastroenterology fellow performance in colonoscopy. Gastrointest Endosc 87(1):262-269.

Direct observation of procedural skills (DOPS) assessment in diagnostic gastroscopy: nationwide evidence of validity and competency development during training.

BACKGROUND: Validated competency assessment tools and the data supporting milestone development during gastroscopy training are lacking. We aimed to assess the validity of the formative direct observation of procedural skills (DOPS) assessment tool in diagnostic gastroscopy and study competency development using DOPS. METHODS: This was a prospective multicentre (N = 275) analysis of formative gastroscopy DOPS assessments. Internal structure validity was tested using exploratory factor analysis and reliability estimated using generalisability theory. Item and global DOPS scores were stratified by lifetime procedure count to define learning curves, using a threshold determined from receiver operator characteristics (ROC) analysis. Multivariable binary logistic regression analysis was performed to identify independent predictors of DOPS competence. RESULTS: In total, 10086 DOPS were submitted for 987 trainees. Exploratory factor analysis identified three distinct item groupings, representing 'pre-procedure', 'technical', and 'post-procedure non-technical' skills. From generalisability analyses, sources of variance in overall DOPS scores included trainee ability (31%), assessor stringency (8%), assessor subjectivity (18%), and trainee case-to-case variation (43%). The combination of three assessments from three assessors was sufficient to achieve the reliability threshold of 0.70. On ROC analysis, a mean score of 3.9 provided optimal sensitivity and specificity for determining competency. This threshold was attained in the order of 'pre-procedure' (100-124 procedures), 'technical' (150-174 procedures), 'post-procedure non-technical' skills (200-224 procedures), and global competency (225-249 procedures). Higher lifetime procedure count, DOPS count, surgical trainees and assessors, higher trainee seniority, and lower case difficulty were significant multivariable predictors of DOPS competence. CONCLUSION: This study establishes milestones for competency acquisition during gastroscopy training and provides validity and reliability evidence to support gastroscopy DOPS as a competency assessment tool.

Changes in scoring of Direct Observation of Procedural Skills (DOPS) forms and the impact on competence assessment.

BACKGROUND: Direct Observation of Procedural Skills (DOPS) is an established competence assessment tool in endoscopy. In July 2016, the DOPS scoring format changed from a performance-based scale to a supervision-based scale. We aimed to evaluate the impact of changes to the DOPS scale format on the distribution of scores in novice trainees and on competence assessment. METHODS: We performed a prospective, multicenter (n = 276), observational study of formative DOPS assessments in endoscopy trainees with ≤ 100 lifetime procedures. DOPS were submitted in the 6-months before July 2016 (old scale) and after (new scale) for gastroscopy (n = 2998), sigmoidoscopy (n = 1310), colonoscopy (n = 3280), and polypectomy (n = 631). Scores for old and new DOPS were aligned to a 4-point scale and compared. RESULTS: 8219 DOPS (43 % new and 57 % old) submitted for 1300 trainees were analyzed. Compared with old DOPS, the use of the new DOPS was associated with greater utilization of the lowest score (2.4 % vs. 0.9 %; P < 0.001), broader range of scores, and a reduction in competent scores (60.8 % vs. 86.9 %; P < 0.001). The reduction in competent scores was evident on subgroup analysis across all procedure types (P < 0.001) and for each quartile of endoscopy experience. The new DOPS was superior in characterizing the endoscopy learning curve by demonstrating progression of competent scores across quartiles of procedural experience. CONCLUSIONS: Endoscopy assessors applied a greater range of scores using the new DOPS scale based on degree of supervision in two cohorts of trainees matched for experience. Our study provides construct validity evidence in support of the new scale format.

Prognostic impact of deprivation on esophagogastroduodenoscopy outcome.

Background and study aims Socioeconomic deprivation has long been associated with many gastrointestinal diseases, yet its influence on esophagogastroduodenoscopy (EGD) diagnosis has not been evaluated. The aim of this study was to investigate the influence of deprivation on outcomes of EGD irrespective of referral reason. Patients and methods Two thousand consecutive patients presenting to four Health Boards in Wales beginning in June 2019 were studied retrospectively with deprivation scores calculated using the Wales Indices of Multiple Deprivation (WIMD). Patients were subclassified into quintiles for analysis (Q1 most, Q5 least deprived). Results Inhabitants of the most deprived areas were more likely to be diagnosed with peptic ulcer (Q1 7.9%, Q5 4.7%; odds ratio [OR] 0.498, P =0.018), severe esophagitis (LA4, Q1 2.7% v Q5 0%, OR 0.089, P 0.002), Helicobacter pylori infection (Q1 5.4%, Q5 1.7%; OR 0.284, P =0.002), but less likely to be diagnosed with Barrett's esophagus (Q1 6.3% v Q5 12.3%, OR 2.146, P =0.004) than those from the least deprived areas. New cancer diagnoses numbered 53 and were proportionately higher after presentation for urgent suspected cancer (USC, n=35, 4.6%) than for routine referrals (n=3, 0.6%, P < 0.001). Deprivation was associated with more advanced stage cancer (stage III Q1 16.7% v Q5 5.6%, OR 0.997, P =0.006: stage IV Q1 16.7% v Q2 38.9% v Q5 22.2%, OR 0.998, P =0.049). Conclusions Deprivation was associated with two-fold more peptic ulcer disease, three-fold more H. pylori infection, and 12-fold more severe esophagitis, and more advanced cancer stage.

Hospital compound-level endoscopy training quality performance: scoping the spectrum.

Background and study aims This study aimed to assess the quality of endoscopy training in a UK Statutory Educational Body compared with Joint Advisory Group on Gastrointestinal Endoscopy Training standards (JETS). Methods A total of 28,298 training procedures recorded by 211 consecutive cross-specialty trainee endoscopists registered with JETS in 18 hospitals during 2019 were analyzed. Data included trainer and trainee numbers, training list frequency, procedures, direct observation of procedural skills (DOPS) completion, and key performance indicators. Results Annual median training procedures per hospital were 1395 (interquartile range (IQR) 465-2365). Median trainers and trainees per unit were 11 (6-18) and 12 (7-16), respectively, (ratio 0.8 [0.7-1.3]). Annual training list frequency per trainee was 13 (10-17), 35.0 % short of Joint Advisory Group (JAG) standard (n = 20, P = 0.001, effect size -0.56). Median points per adjusted training list were 11 (5-18). Median DOPS per trainee and trainer were three (1-6) and four (1-7) respectively; completing 0.2 DOPS (0.1-0.4) per list and amounting to six (2-12) per 200 procedures: fewer than half of the JAG standard (20 per 200) (P < 0.001, -0.61). Esophagogastroduodenoscopy median KPI: J maneuver 94 % (90-96), D2 intubation 93 % (91-96); Colonoscopy KPI: cecal intubation 82 % (72-90), polyp detection rate 25 % (18-34). Compound hospital score ranged from nine to 26 (median 17 [14-20]). Conclusions Important performance disparity emerged with three-fold variation in compound hospital training quality and most units underperforming compared with JAG standards. Trainees and training program directors should be aware of such metrics to improve quality endoscopy educational programs and consider formal adjuncts to optimize training.

Face validity of a virtual reality simulation platform to improve competency in endoscopy: a prospective observational cohort study.

Background and study aims Virtual reality endoscopic simulation training has the potential to expedite competency development in novice trainees. However, simulation platforms must be realistic and confer face validity. This study aimed to determine the face validity of high-fidelity virtual reality simulation (EndoSim, Surgical Science, Gothenburg), and establish benchmark metrics to guide the development of a Simulation Pathway to Improve Competency in Endoscopy (SPICE). Methods A pilot cohort of four experts rated simulated exercises (Likert scale score 1-5) and following iterative development, 10 experts completed 13 simulator-based endoscopy exercises amounting to 859 total metric values. Results Expert metric performance demonstrated equivalence ( P  = 0.992). In contrast, face validity of each exercise varied among experts (median 4 (interquartile range [IQR] 3-5), P  < 0.003) with Mucosal Examination receiving the highest scores (median 5 [IQR 4.5-5], P  = 1.000) and Loop Management and Intubation exercises receiving the lowest scores (median 3 [IQR 1-3], P  < 0.001, P  = 0.004), respectively. The provisional validated SPICE comprised 13 exercises with pass marks and allowance buffers defined by median and IQR expert performance. Conclusions EndoSim Face Validity was very good related to early scope handling skills, but more advanced competencies and translation of acquired clinical skills require further research within an established training program. The existing training deficit with superadded adverse effects of the COVID pandemic make this initiative an urgent priority.

UK Joint Advisory Group consensus statements for training and certification in endoscopic retrograde cholangiopancreatography.

Background and study aims Despite the high-risk nature of endoscopic retrograde cholangiopancreatography (ERCP), a robust and standardized credentialing process to ensure competency before independent practice is lacking worldwide. On behalf of the Joint Advisory Group (JAG), we aimed to develop evidence-based recommendations to form the framework of ERCP training and certification in the UK. Methods Under the oversight of the JAG, a modified Delphi process was conducted with stakeholder representation from the British Society of Gastroenterology, Association of Upper Gastrointestinal Surgeons, trainees and trainers. Recommendations on ERCP training and certification were formulated after formal literature review and appraised using the GRADE tool. These were subjected to electronic voting to achieve consensus. Accepted statements were peer-reviewed by JAG and relevant Specialist Advisory Committees before incorporation into the ERCP certification pathway. Results In total, 27 recommendation statements were generated for the following domains: definition of competence (9 statements), acquisition of competence (8 statements), assessment of competence (6 statements) and post-certification support (4 statements). The consensus process led to the following criteria for ERCP certification: 1) performing ≥ 300 hands-on procedures; 2) attending a JAG-accredited ERCP skills course; 3) in modified Schutz 1-2 procedures: achieving native papilla cannulation rate ≥80%, complete bile duct clearance ≥ 70 %, successful stenting of distal biliary strictures ≥ 75 %, physically unassisted in ≥ 80 % of cases; 4) 30-day post-ERCP pancreatitis rates ≤5 %; and 5) satisfactory performance in formative and summative direct observation of procedural skills (DOPS) assessments. Conclusions JAG certification in ERCP has been developed following evidence-based consensus to quality assure training and to ultimately improve future standards of ERCP practice.

Erratum: UK Joint Advisory Group consensus statements for training and certification in endoscopic retrograde cholangiopancreatography.

[This corrects the article DOI: 10.1055/a-1629-7540.].

Impact of a simulation-based induction programme in gastroscopy on trainee outcomes and learning curves.

BACKGROUND: Pre-clinical simulation-based training (SBT) in endoscopy has been shown to augment trainee performance in the short-term, but longer-term data are lacking. AIM: To assess the impact of a two-day gastroscopy induction course combining theory and SBT (Structured PRogramme of INduction and Training - SPRINT) on trainee outcomes over a 16-mo period. METHODS: This prospective case-control study compared outcomes between novice SPRINT attendees and controls matched from a United Kingdom training database. Study outcomes comprised: (1) Unassisted D2 intubation rates; (2) Procedural discomfort scores; (3) Sedation practice; (4) Time to 200 procedures; and (5) Time to certification. RESULTS: Total 15 cases and 24 controls were included, with mean procedure counts of 10 and 3 (P = 0.739) pre-SPRINT. Post-SPRINT, no significant differences between the groups were detected in long-term D2 intubation rates (P = 0.332) or discomfort scores (P = 0.090). However, the cases had a significantly higher rate of unsedated procedures than controls post-SPRINT (58% vs 44%, P = 0.018), which was maintained over the subsequent 200 procedures. Cases tended to perform procedures at a greater frequency than controls in the post-SPRINT period (median: 16.2 vs 13.8 per mo, P = 0.051), resulting in a significantly greater proportion of cases achieving gastroscopy certification by the end of follow up (75% vs 36%, P = 0.017). CONCLUSION: In this pilot study, attendees of the SPRINT cohort tended to perform more procedures and achieved gastroscopy certification earlier than controls. These data support the role for wider evaluation of pre-clinical induction involving SBT.

Impact of the Joint Advisory Group on Gastrointestinal Endoscopy (JAG) on endoscopy services in the UK and beyond.

The Joint Advisory Group on Gastrointestinal Endoscopy (JAG) was initially established in 1994 to standardise endoscopy training across specialties. Over the last two decades, the position of JAG has evolved to meet its current role of quality assuring all aspects of endoscopy in the UK to provide the highest quality, patient-centred care. Drivers such as changes to healthcare agenda, national audits, advances in research and technology and the advent of population-based cancer screening have underpinned this shift in priority. Over this period, JAG has spearheaded various quality assurance initiatives with support from national stakeholders. These have led to the achievement of notable milestones in endoscopy quality assurance, particularly in the three major areas of: (1) endoscopy training, (2) accreditation of endoscopy services (including the Global Rating Scale), and (3) accreditation of screening endoscopists. These developments have changed the landscape of UK practice, serving as a model to promote excellence in endoscopy. This review provides a summary of JAG initiatives and assesses the impact of JAG on training and endoscopy services within the UK and beyond.

Certification of UK gastrointestinal endoscopists and variations between trainee specialties: results from the JETS e-portfolio.

Introduction In the UK, endoscopy certification is administered by the Joint Advisory Group on Gastrointestinal Endoscopy (JAG). Since 2011, certification for upper and lower gastrointestinal endoscopy has been awarded via a national (JETS) e-portfolio to the main training specialties of: gastroenterology, gastrointestinal surgeons (GS) and non-medical endoscopists (NME). Trends in endoscopy certification and differences between trainee specialties were analyzed. Methods This prospective UK-wide observational study identified trainees awarded gastroscopy, sigmoidoscopy, colonoscopy (provisional and full) certification between June 2011 - 2017. Trends in certification, procedures and time-to-certification, and key performance indicators (KPIs) in the 3-month pre- and post-certification period were compared between the three main training specialties. Results Three thousand one hundred fifty-seven endoscopy-related certifications were awarded to 1928 trainees from gastroenterology (52.3 %), GS (28.4 %) and NME (16.5 â€Š%) specialties. During the study period, certification numbers increased for all modalities and specialties, particularly NME trainees. For gastroscopy and colonoscopy, procedures-to-certification were lowest for GS ( P  < 0.001), whereas time-to-certification was consistently shortest in NMEs ( P  < 0.001). A post-certification reduction in mean cecal intubation rate (95.2 % to 93.8 %, P  < 0.001) was observed in colonoscopy, and D2 intubation (97.6 % to 96.2 %, P  < 0.001) and J-maneuver (97.3 % to 95.8 %, P  < 0.001) in gastroscopy. Overall, average pre- and post-certification KPIs still exceeded national minimum standards. There was an increase in PDR for NMEs after provisional colonoscopy certification but a decrease in PDR for GS trainees after sigmoidoscopy and full colonoscopy certification. Conclusion Despite variations among trainee specialties, average pre- and post-certification KPIs for certified trainees met national standards, suggesting that JAG certification is a transparent benchmark which adequately safeguards competency in endoscopy training.

Training in Endoscopy.

PURPOSE OF THE REVIEW: Progress towards the goal of high-quality endoscopy across health economies has been founded on high-quality structured training programmes linked to credentialing practice and ongoing performance monitoring. This review appraises the recent literature on training interventions, which may benefit performance and competency acquisition in novice endoscopy trainees. RECENT FINDINGS: Increasing data on the learning curves for different endoscopic procedures has highlighted variations in performance amongst trainees. These differences may be dependent on the trainee, trainer and training programme. Evidence of the benefit of knowledge-based training, simulation training, hands-on courses and clinical training is available to inform the planning of ideal training pathway elements. The validation of performance assessment measures and global competency tools now also provides evidence on the effectiveness of training programmes to influence the learning curve. The impact of technological advances and intelligent metrics from national databases is also predicted to drive improvements and efficiencies in training programme design and monitoring of post-training outcomes. Training in endoscopy may be augmented through a series of pre-training and in-training interventions. In conjunction with performance metrics, these evidence-based interventions could be implemented into training pathways to optimise and quality assure training in endoscopy.

Combining the audit questionnaire and biochemical markers to assess alcohol use and risk of alcohol withdrawal in medical inpatients.

AIMS: Alcohol consumption is often under-reported in patients admitted to general hospitals with acute illness. For alcohol-dependent individuals hospital admission results in an enforced period of abstinence with potential alcohol withdrawal symptoms, and possible life threatening complications. Early detection of alcohol use is therefore beneficial to patients and health services. The purpose of this study was to investigate the performance of the alcohol use disorders identification test (AUDIT) questionnaire in the acute medical setting, and the effect of combining routine biological markers-glutamyltransferase, alanine aminotransferase, aspartate aminotransferase, and mean corpuscular volume (MCV) on its performance in the early identification of in-patients with alcohol use disorders and at risk of developing symptoms of alcohol withdrawal. METHODS: Prospective study in consecutive patients admitted to an acute medical admissions ward. All patients were screened using the AUDIT questionnaire and routine blood tests. Patients were then monitored for symptoms of withdrawal using clinical institute withdrawal assessment for alcohol (CIWA-Ar). RESULTS: Of the 874 patients screened using the AUDIT, 98 (11%) screened positive of whom 17 (2% of the 874) experienced clinically significant alcohol withdrawal symptoms, when using serial CIWA-Ar. The AUDIT and serial CIWA-Ar detected all patients who went on to manifest acute withdrawal symptoms. There was no loss of sensitivity at an AUDIT cut-off of 13 or more compared with the lower cut-off of 8 or more. A positive predictive value of 17.3% for an AUDIT score of 8 or more in the detection of withdrawal, increased to 47.1% when found in combination with at least two abnormal biological markers whilst maintaining a sensitivity of 94.1% and specificity of 97.9%. CONCLUSION: These findings confirm that AUDIT is a useful alcohol screen in general medical settings and that its ability to correctly predict which patients will experience alcohol withdrawal is increased when used in combination with biological markers.

A randomized trial of nicotine enemas for active ulcerative colitis.

BACKGROUND & AIMS: Ulcerative colitis (UC) is largely a disease of nonsmokers in which transdermal nicotine improves the symptoms but often causes adverse events (AEs). Nicotine enemas cause fewer AEs and were used as supplemental treatment for active UC. METHODS: We treated 104 patients with active UC with either 6-mg nicotine enemas or placebo enemas for 6 weeks in a randomized double-blind study. Patients continued their oral therapy, if any, for UC: 68 patients were taking mesalamine, 15 patients were taking prednisolone, and 12 patients were taking thiopurines during the study. Clinical, sigmoidoscopic, and histologic assessments were made at baseline and at the end of the study and symptoms were recorded daily on a diary card. The primary end point was induction of clinical remission and clinical improvement also was measured by the UC disease activity index. After the study, patients then used nicotine enemas daily for 4 weeks and sigmoidoscopy with a biopsy examination was repeated. AEs and salivary cotinine levels were monitored throughout the study. RESULTS: Clinical remission was achieved in 14 of 52 (27%) patients on active treatment and 14 of 43 (33%) patients on placebo (P = .55). The UC disease activity index improved by 1.45 points in the active group and by 1.65 points for those on placebo (P = .88). Only 1 patient discontinued treatment because of an AE (abdominal pain). In the 47 patients taking mesalamine only, active treatment conferred benefit that was not statistically significant; disease remission occurred in 9 of 25 patients on active therapy and 4 of 21 patients on placebo (P = .20). CONCLUSIONS: Six-milligram nicotine enemas were well tolerated but were not found to be efficacious for active UC.