Development of the "Teamwork in Endoscopy Assessment Module for Endoscopic Non-Technical Skills" (TEAM-ENTS) behavioral marker system.

BACKGROUND: Non-technical skills (NTS) are integral to team performance and subsequent quality and safety of care. Behavioral marker systems (BMSs) are now increasingly used in healthcare to support the training and assessment of team NTS. Within gastrointestinal endoscopy, this is an area of novel research. The aims of this study were to define the core relevant NTS for endoscopy teams and develop a preliminary framework for a team-based BMS known as TEAM-ENTS (Teamwork in Endoscopy Assessment Module for Endoscopic Non-Technical Skills). METHODS: This study was conducted in two phases. In phase 1, a literature review of team-based BMSs was performed to inform an interview study of core endoscopy team members. Cognitive task analysis was used to break down the NTS relevant to endoscopy teams. Framework analysis generated the structure for the preliminary TEAM-ENTS framework. In phase 2, a modified Delphi process was undertaken to refine the items of the framework. RESULTS: Seven consultant endoscopists and six nurses were interviewed. The final coding framework consisted of 88 codes grouped into five overarching categories. In total, 58 participants were recruited to the Delphi panel. In the first round, nine elements and 37 behavioral descriptors did not meet consensus. Following item adjustment, merging and deletion, all remaining items met consensus thresholds after the second round. The refined TEAM-ENTS BMS consists of five categories, 16 elements, and 47 behavioral descriptors. CONCLUSIONS: The refined TEAM-ENTS behavioral marker system was developed to reflect the core NTS relevant to endoscopy teams. Future studies will aim to fully validate this tool.

Training and assessment in flexible sigmoidoscopy: using a novel direct observation of procedural skills (DOPS) assessment tool.

BACKGROUND AND AIMS: Data supporting milestone development during flexible sigmoidoscopy (FS) training are lacking. We aimed to present validity evidence for our formative direct observation of procedural skills (DOPS) assessment in FS, and use DOPS to establish competency benchmarks and define learning curves for a national training cohort. METHODS: This prospective UK-wide (211 centres) study included all FS formative DOPS assessments submitted to the national e-portfolio. Reliability was estimated from generalisability theory analysis. Item and global DOPS scores were correlated with lifetime procedure count to study learning curves, with competency benchmarks defined using contrasting groups analysis. Multivariable binary logistic regression was performed to identify independent predictors of DOPS competence. RESULTS: This analysis included 3,616 DOPS submitted for 468 trainees. From generalisability analysis, sources of overall competency score variance included: trainee ability (27%), assessor stringency (15%), assessor subjectivity attributable to the trainee (18%) and case-to-case variation (40%), which enabled the modelling of reliability estimates. The competency benchmark (mean DOPS score: 3.84) was achieved after 150-174 procedures. Across the cohort, competency development occurred in the order of: pre-procedural (50-74), non-technical (75-149), technical (125-174) and post-procedural (175-199) skills. Lifetime procedural count (p<0.001), case difficulty (p<0.001), and lifetime formative DOPS count (p=0.001) were independently associated with DOPS competence, but not trainee or assessor specialty. CONCLUSION: Sigmoidoscopy DOPS can provide valid and reliable assessments of competency during training and can be used to chart competency development. Contrary to earlier studies, based on destination-orientated endpoints, overall competency in sigmoidoscopy was attained after 150 lifetime procedures.

Evaluation of a minimally invasive cell sampling device coupled with assessment of trefoil factor 3 expression for diagnosing Barrett's esophagus: a multi-center case-control study.

BACKGROUND: Barrett's esophagus (BE) is a commonly undiagnosed condition that predisposes to esophageal adenocarcinoma. Routine endoscopic screening for BE is not recommended because of the burden this would impose on the health care system. The objective of this study was to determine whether a novel approach using a minimally invasive cell sampling device, the Cytosponge, coupled with immunohistochemical staining for the biomarker Trefoil Factor 3 (TFF3), could be used to identify patients who warrant endoscopy to diagnose BE. METHODS AND FINDINGS: A case-control study was performed across 11 UK hospitals between July 2011 and December 2013. In total, 1,110 individuals comprising 463 controls with dyspepsia and reflux symptoms and 647 BE cases swallowed a Cytosponge prior to endoscopy. The primary outcome measures were to evaluate the safety, acceptability, and accuracy of the Cytosponge-TFF3 test compared with endoscopy and biopsy. In all, 1,042 (93.9%) patients successfully swallowed the Cytosponge, and no serious adverse events were attributed to the device. The Cytosponge was rated favorably, using a visual analogue scale, compared with endoscopy (p < 0.001), and patients who were not sedated for endoscopy were more likely to rate the Cytosponge higher than endoscopy (Mann-Whitney test, p < 0.001). The overall sensitivity of the test was 79.9% (95% CI 76.4%-83.0%), increasing to 87.2% (95% CI 83.0%-90.6%) for patients with ≥3 cm of circumferential BE, known to confer a higher cancer risk. The sensitivity increased to 89.7% (95% CI 82.3%-94.8%) in 107 patients who swallowed the device twice during the study course. There was no loss of sensitivity in patients with dysplasia. The specificity for diagnosing BE was 92.4% (95% CI 89.5%-94.7%). The case-control design of the study means that the results are not generalizable to a primary care population. Another limitation is that the acceptability data were limited to a single measure. CONCLUSIONS: The Cytosponge-TFF3 test is safe and acceptable, and has accuracy comparable to other screening tests. This test may be a simple and inexpensive approach to identify patients with reflux symptoms who warrant endoscopy to diagnose BE.