Changes in scoring of Direct Observation of Procedural Skills (DOPS) forms and the impact on competence assessment.

BACKGROUND: Direct Observation of Procedural Skills (DOPS) is an established competence assessment tool in endoscopy. In July 2016, the DOPS scoring format changed from a performance-based scale to a supervision-based scale. We aimed to evaluate the impact of changes to the DOPS scale format on the distribution of scores in novice trainees and on competence assessment. METHODS: We performed a prospective, multicenter (n = 276), observational study of formative DOPS assessments in endoscopy trainees with ≤ 100 lifetime procedures. DOPS were submitted in the 6-months before July 2016 (old scale) and after (new scale) for gastroscopy (n = 2998), sigmoidoscopy (n = 1310), colonoscopy (n = 3280), and polypectomy (n = 631). Scores for old and new DOPS were aligned to a 4-point scale and compared. RESULTS: 8219 DOPS (43 % new and 57 % old) submitted for 1300 trainees were analyzed. Compared with old DOPS, the use of the new DOPS was associated with greater utilization of the lowest score (2.4 % vs. 0.9 %; P < 0.001), broader range of scores, and a reduction in competent scores (60.8 % vs. 86.9 %; P < 0.001). The reduction in competent scores was evident on subgroup analysis across all procedure types (P < 0.001) and for each quartile of endoscopy experience. The new DOPS was superior in characterizing the endoscopy learning curve by demonstrating progression of competent scores across quartiles of procedural experience. CONCLUSIONS: Endoscopy assessors applied a greater range of scores using the new DOPS scale based on degree of supervision in two cohorts of trainees matched for experience. Our study provides construct validity evidence in support of the new scale format.

The cost-effectiveness of training US primary care physicians to conduct colorectal cancer screening in family medicine residency programs.

BACKGROUND: Demand for a wide array of colorectal cancer screening strategies continues to outpace supply. One strategy to reduce this deficit is to dramatically increase the number of primary care physicians who are trained and supportive of performing office-based colonoscopies or flexible sigmoidoscopies. This study evaluates the clinical and economic implications of training primary care physicians via family medicine residency programs to offer colorectal cancer screening services as an in-office procedure. METHODS: Using previously established clinical and economic assumptions from existing literature and budget data from a local grant (2013), incremental cost-effectiveness ratios are calculated that incorporate the costs of a proposed national training program and subsequent improvements in patient compliance. Sensitivity analyses are also conducted. RESULTS: Baseline assumptions suggest that the intervention would produce 2394 newly trained residents who could perform 71,820 additional colonoscopies or 119,700 additional flexible sigmoidoscopies after ten years. Despite high costs associated with the national training program, incremental cost-effectiveness ratios remain well below standard willingness-to-pay thresholds under base case assumptions. Interestingly, the status quo hierarchy of preferred screening strategies is disrupted by the proposed intervention. CONCLUSIONS: A national overhaul of family medicine residency programs offering training for colorectal cancer screening yields satisfactory incremental cost-effectiveness ratios. However, the model places high expectations on primary care physicians to improve current compliance levels in the US.

A comprehensive training programme for nurse endoscopist performing flexible sigmoidoscopy in Hong Kong.

AIMS: To describe the process and explore the feasibility of training a colorectal nurse in Hong Kong to perform flexible sigmoidoscopy. BACKGROUND: Given the shortage and high turnover rate of medical staff, a pilot programme was designed to train and expand the role of colorectal nurse clinicians. It was hoped that such nurses could share some of the clinical duties of the medical staff. An advanced practice nurse was selected for the programme. One of the training components was the performance of flexible sigmoidoscopy. DESIGN: This was a descriptive, case review study. METHOD: A one-year-structured endoscopic training programme was designed for the nurse clinician. Weekly sessions were conducted by one of the trainers. The training process included the following: (1) procedural observation; (2) supervised withdrawal, advancement and manipulation of the sigmoidoscope and (3) a final assessment of the nurse's competency in performing sigmoidoscopy independently. RESULTS: In total, 119 outpatients (58 male and 61 female) with a mean age of 57·02 years (SD 14·6 years; range: 18-83 years) underwent flexible sigmoidoscopy by the nurse over 11 months. The mean procedural time was 9·38 minutes (SD 3·5 minutes; range 3-26 minutes). The procedure was terminated prematurely if it could not be tolerated by the patient or if the bowel preparation was inadequate. The mean depth of insertion was 53·5 cm (SD 12·2 cm; range 6-60 cm). In total, 82 patients had a normal exam, 32 patients had abnormalities. There were no procedural complications, and no patient required an unplanned hospital admission after the procedure. CONCLUSION: In Queen Mary Hospital, nurses can be trained to perform flexible sigmoidoscopy in a safe and effective manner. RELEVANCE TO CLINICAL PRACTICE: Nurse endoscopists could increase the use of flexible sigmoidoscopy in colorectal cancer screening and can also enhance the professional development of colorectal nurses.

Training and assessment in flexible sigmoidoscopy: using a novel direct observation of procedural skills (DOPS) assessment tool.

BACKGROUND AND AIMS: Data supporting milestone development during flexible sigmoidoscopy (FS) training are lacking. We aimed to present validity evidence for our formative direct observation of procedural skills (DOPS) assessment in FS, and use DOPS to establish competency benchmarks and define learning curves for a national training cohort. METHODS: This prospective UK-wide (211 centres) study included all FS formative DOPS assessments submitted to the national e-portfolio. Reliability was estimated from generalisability theory analysis. Item and global DOPS scores were correlated with lifetime procedure count to study learning curves, with competency benchmarks defined using contrasting groups analysis. Multivariable binary logistic regression was performed to identify independent predictors of DOPS competence. RESULTS: This analysis included 3,616 DOPS submitted for 468 trainees. From generalisability analysis, sources of overall competency score variance included: trainee ability (27%), assessor stringency (15%), assessor subjectivity attributable to the trainee (18%) and case-to-case variation (40%), which enabled the modelling of reliability estimates. The competency benchmark (mean DOPS score: 3.84) was achieved after 150-174 procedures. Across the cohort, competency development occurred in the order of: pre-procedural (50-74), non-technical (75-149), technical (125-174) and post-procedural (175-199) skills. Lifetime procedural count (p<0.001), case difficulty (p<0.001), and lifetime formative DOPS count (p=0.001) were independently associated with DOPS competence, but not trainee or assessor specialty. CONCLUSION: Sigmoidoscopy DOPS can provide valid and reliable assessments of competency during training and can be used to chart competency development. Contrary to earlier studies, based on destination-orientated endpoints, overall competency in sigmoidoscopy was attained after 150 lifetime procedures.

Training resident physicians in fiberoptic sigmoidoscopy. How many supervised examinations are required to achieve competence?

Twenty-five resident physicians performed 495 fiberoptic sigmoidoscopic examinations that were graded for overall skill according to a six-point competence scale. In general, 24 to 30 examinations were required to become competent at fiberoptic sigmoidoscopy. Trainees with prior rigid sigmoidoscopy experience achieved competence more quickly than those with no prior rigid sigmoidoscopy experience. As experience increased, unassisted insertion distance and luminal visualization increased, insertion time and assisted time decreased, and management scores and percent correct diagnoses improved. Trainees detected 93 to 100 percent of polyps and cancers viewed by the experienced sigmoidoscopist once competence was achieved. These data indicate that programs for training primary care physicians in fiberoptic sigmoidoscopy are feasible, help define the number of examinations required to become competent, and indicate that such trainees should be effective in cancer screening.

Evaluation of endoscopy training in a general surgery residency.

To evaluate the gastrointestinal endoscopy training program, a survey of the 33 former chief residents, who finished our program in 1981-1986, was conducted. All 33 graduates responded; 22 graduates are general surgeons, 11 completed or are completing training in a surgical specialty. Eighteen of the 22 general surgeons routinely perform endoscopy in their practice. Graduates in cities with a population greater than 250,000 are as likely to perform endoscopy as the surgeons who live in smaller communities. Ninety one per cent consider endoscopy training to have been an important part of their surgical training. Based on this assessment, endoscopy training is an important part of a general-surgery residency.

Another exciting use for the cantaloupe.

This paper describes an organic model used successfully to demonstrate flexible sigmoidoscopy to family medicine residents. Its advantages include low cost, portability, disposability, and ease with which it induces laughter while its drawbacks are unique and well worth tolerating.

A supervised training program in flexible sigmoidoscopy: evaluating skills from residency training to clinical practice.

To assess the effectiveness of a training program in flexible sigmoidoscopy for family practice residents, we prospectively studied the performance of four residents during their training and after graduation. One hundred and four training exams performed with the assistance of an experienced gastroenterologist were compared with 118 unassisted post-training, post-residency exams. The mean depth of insertion for the post-training period was 51.1 +/- 1.2 cm, which was significantly greater (P less than .05, Student's t test) than the mean training period depth of 47.6 +/- 1.2 cm. There was no significant difference in the identification of polyps or cancer between the training and post-training periods. The mean duration of an exam was 17.3 +/- 0.6 minutes in the post-training period. No significant complications were encountered in either period. The residency trained family physicians obtained results similar to those reported by trained endoscopists in depth of examination and pathology detected, although their examinations required more time. We conclude that this model of training was effective in the development of flexible sigmoidoscopy procedural skill for family practice residents.

Teaching sigmoidoscopy to primary care physicians: a controlled study of continuing medical education.

A sigmoidoscopy skills preceptorship was developed for physicians to increase the rate of sigmoidoscopy by physicians in a health maintenance organization. The preceptorship was designed as a randomized, controlled study of continuing medical education. Baseline sigmoidoscopy rates of participating physicians were similar to those of nonparticipants, as were selected demographic and professional characteristics. Physicians randomized to receive sigmoidoscopy training significantly increased their rate of sigmoidoscopy when compared with controls. The proportion of barium enemas accompanied by sigmoidoscopy likewise increased. All physicians who participated improved when compared with nonparticipants. The sigmoidoscopy skills preceptorship appears to be a worthwhile endeavor in continuing medical education.

Flexible sigmoidoscopy.

Flexible sigmoidoscopy became available in 1976. To date, studies comparing it with rigid sigmoidoscopy support an increase of 2.5 to six times in the flexible sigmoidoscope's ability to detect polyps, and a two- to threefold increase in detection of colonic neoplasms in the same patients. This paper summarizes the current reported results of flexible sigmoidoscopy to date and describes the instrument and procedure as done at the UCLA Family Practice Residency Program. The flexible sigmoidoscope deserves evaluation for widespread primary care application.

Flexible fiberoptic sigmoidoscopy. Logistics and economics of office use.

Early detection of colorectal cancer, followed by surgical excision, can effect a cure in 50% of patients. The flexible fiberoptic sigmoidoscope enables identification of lesions in the premalignant or early malignant stages. Its use is cost-effective in any practice that includes more than 200 to 300 patients over age 50, and the procedure is well accepted by patients. Available options for learning the technique are listed, along with their approximate fees. The author explores all considerations pertinent to instituting this screening procedure and suggests the best way to introduce sigmoidoscopy into the established office routine.

Quality assurance of endoscopy in colorectal cancer screening.

This chapter explores the concept of quality assurance of colorectal cancer screening. It argues that effective quality assurance is critical to ensure that the benefits of screening outweigh the harms. The three key steps of quality assurance, definition of standards, measurement of standards and enforcement of standards, are explained. Quality is viewed from the perspective of the patient and illustrated by following the path of patients accessing endoscopy within screening services. The chapter discusses the pros and cons of programmatic versus non-programmatic screening and argues that quality assurance of screening can and should benefit symptomatic services. Finally, the chapter emphasises the importance of a culture of excellence underpinned by continuous quality improvement and effective service leadership.

Training in sigmoidoscopy. An assessment in three teaching hospitals.

To assess the standard of training in postgraduate sigmoidoscopy in Melbourne, a questionnaire was prepared and distributed to resident medical officers (RMOs) in three teaching hospitals. The survey showed that practical instruction in technique is inadequate, and that most individuals perform too few sigmoidoscopies to become competent at either examining or recognizing lesions. A substantial number of RMOs had never seen common and important lesions such as polyps or colorectal cancer. Most RMOs considered their training to be poor and stated that they lacked confidence in their ability to perform sigmoidoscopy. The current training programme needs detailed reassessment and improvement.

Training for flexible sigmoidoscopy.

Three hundred twenty-six participants of five 1-day continuing medical education courses on flexible sigmoidoscopy were surveyed to determine their use of lower intestinal endoscopes and to identify how well the education trained them to use the flexible sigmoidoscope. The number of participants using a flexible sigmoidoscope and/or colonoscope increased after the course. About one half of the respondents went from no use of the flexible sigmoidoscope to using it. About one fifth of the respondents were not using a flexible sigmoidoscope after the course for various reasons. Most respondents used more than one instrument after the course, with the combination of the 60-cm flexible sigmoidoscope and the rigid sigmoidoscope being most popular. The overwhelming majority found the flexible sigmoidoscope to be either very easy to use or reasonably easy to use. Only one complication was reported. Most of the respondents had attended only this 1-day course, but one third had taken either other courses or had been supervised for several procedures.

Training primary care physicians in flexible sigmoidoscopy--performance evaluation of 17,167 procedures.

The flexible fiber-optic sigmoidoscope is rapidly replacing the rigid sigmoidoscope in routine screening for colorectal cancer. This study was undertaken to evaluate the safety, usage pattern, and efficacy of fiber-optic sigmoidoscopy by evaluating the outcome of training and the results of procedures carried out by a group of primary care physicians. Of 1,153 participants in one-day flexible sigmoidoscopy workshops, 764 (66%) returned questionnaires evaluating their experiences following this training. Of these, 438 physicians had obtained a flexible sigmoidoscope, used it frequently, and had done a total of 17,167 examinations. The average time of scope usage was nine months. Although additional supervised training was suggested at the time of the workshop, 68% of physicians began doing flexible sigmoidoscopy without it. A total of 465 polyps and 153 cancers were detected by the study group for an overall detection rate of 2.7% for polyps and 0.9% for cancers. Four complications were reported. This study indicates that the technique of flexible sigmoidoscopy is readily learned, is diagnostically productive, and is reasonably safe in the hands of primary care physicians.

AAFP--ASGE conjoint course on flexible sigmoidoscopy.

The first multidisciplinary course developed jointly by the American Academy of Family Physicians and the American Society for Gastrointestinal Endoscopy is described. This prototype program was designed to teach the skills of 35 cm flexible sigmoidoscopy (FS) to twenty family physicians. Gastroenterologist preceptors determined that all 20 family physicians could perform this procedural skill within ten supervised cases. A control group of family physicians was studied to determine flexible sigmoidoscope acquisition frequencies in separate cohorts (Continuing Medical Education (CME) versus no CME on flexible sigmoidoscopy). The study group acquired instruments more frequently (18/19 = 95%) (p less than or equal to .05) than those with previous CME on FS (8/14 = 57%) or without previous CME on FS (2/19 = 11%). Two-thirds of these physicians purchased 60-65 cm flexible instruments rather than the 35 cm instrument. Longitudinal studies will be required to determine whether or not this intervention will have a meaningful impact upon colorectal cancer screening behaviors by primary care physicians.

Flexible sigmoidoscopy: primary care outcomes after two types of continuing medical education.

The office impact of two types of continuing medical education on flexible sigmoidoscopy were compared. Measured office outcomes included sigmoidoscopy utilization rates, depth of insertion, time required to perform the procedure, biopsy rates, acquisition of further training, use of electrocautery, performance of polypectomy, complication rates, and general satisfaction with office flexible sigmoidoscopy. A matched control group was randomly selected and polled for previous flexible sigmoidoscopy continuing medical education and current flexible sigmoidoscopy utilization. Outcomes as they relate to different types of course design were discussed and compared. Procedure times and depth of insertion were comparable to published studies from tertiary care centers. In the faculty intensive course, trainees utilized less procedure time for their initial 10-20 procedures. Attitudes in practice were positive with 68% of all physicians performing biopsy. A 60-cm scope length was chosen by 87% of physicians. Physicians in faculty intensive courses were more likely to obtain additional training and less likely to initiate higher risk procedures such as electrocautery, polypectomy, and colonoscopy.

A study of optimal length of flexible fiberoptic sigmoidoscopes for initial endoscopic training.

Eighteen trainees with no prior fiberoptic endoscopic experience performed a total of 305 fiberoptic sigmoidoscopies using a colonoscope. Basic training, consisting of reading materials, lecture instructions, practice on a colon model, and observation of procedures, was completed prior to beginning patient examinations. Additional instruction was given between examinations. The performance of these examinations was an individual effort on the part of the trainee without verbal or mechanical assistance from the instructor after the initial ten examinations. All were performed with an instructor viewing through a teaching attachment. Total insertion distance was greater than or equal to 30, greater than or equal to 40, greater than or equal to 50, greater than or equal to 60 cm in 65, 60, 46, and 20 percent of examinations, respectively. Overall performance was better in those with prior rigid sigmoidoscopic experience (20 examinations). The mean examination time was 11.8 minutes. These data help to define the appropriate length of fiberoptic sigmoidoscope recommended for use by inexperienced endoscopists.