Varied Trainee Competence in Cold Snare Polypectomy: Results of the COMPLETE Randomized Controlled Trial.

INTRODUCTION: Cold snare polypectomy (CSP) is strongly recommended as the optimal technique for the complete removal of small polyps. Though significant variability in polypectomy technique and quality has been established, the learning curve and impact of targeted training on CSP are unknown. Video feedback has shown promise as an effective pedagogy to improve performance among surgical trainees. We aimed to compare CSP performance between trainees who received video-based feedback and those who received conventional apprentice-based concurrent feedback. We hypothesized that video-based feedback would accelerate competence. METHODS: We conducted a single-blinded, randomized controlled trial on competence for CSP of polyps <1 cm, comparing video-based feedback with conventional feedback. We randomly assigned deidentified consecutively recorded CSP videos to blinded raters to assess using the CSP Assessment Tool. We shared cumulative sum learning curves every 25 CSP with each trainee. The video feedback trainees also received biweekly individualized terminal feedback. Control trainees received conventional feedback during colonoscopy. The primary outcome was CSP competence. We also assessed competence across domains and change over polypectomy volume. RESULTS: We enrolled and randomized 22 trainees, 12 to video-based feedback and 10 to conventional feedback, and evaluated 2,339 CSP. The learning curve was long; 2 trainees (16.7%) in the video feedback achieved competence, after a mean of 135 polyps, and no one in the control ( P = 0.481) achieved competence. Overall and in all steps of CSP, a higher percentage of the video feedback group met competence, increasing 3% every 20 CSP ( P = 0.0004). DISCUSSION: Video feedback aided trainees to competence in CSP. However, the learning curve was long. Our findings strongly suggest that current training methods are not sufficient to support trainees to competency by the completion of their fellowship programs. The impact of new training methods, such as simulation-based mastery learning, should be assessed to determine whether such methods can result in achievement of competence at a faster rate; ClinicalTrials.gov : NCT03115008.

CHANGE LEADERSHIP AND CRISIS MANAGEMENT: CURRICULUM TRANSFORMATION BEFORE, DURING, AND AFTER A PANDEMIC.

Washington University School of Medicine has not undergone substantive curricular change for 25 years. In 2018, we embarked on a curriculum transformation project informed by the change leadership principles of James Kotter and William Bridges. This included developing a structured process to create a sense of urgency for why we needed to change, building coalitions to support change, and developing a compelling vision across multiple stakeholder groups. Implementation work began in 2019 with a planned curriculum start of July 2020. The COVID-19 pandemic disrupted these plans. Employing the Cynefin framework for decision making and guided by our core principles, we were able to launch the new curriculum in September 2020. In this paper, I will describe the principles underpinning our curriculum transformation, how the Cynefin framework allowed us to move forward productively during the COVID-19 crisis, and the impact COVID-19 had, both positively and negatively, on the curriculum transformation process.

Optimizing allocation of curricular content across the Undergraduate & Graduate Medical Education Continuum.

BACKGROUND: Medical educators struggle to incorporate socio-cultural topics into crowded curricula. The "continuum of learning" includes undergraduate and graduate medical education. Utilizing an exemplar socio-cultural topic, we studied the feasibility of achieving expert consensus among two groups of faculty (experts in medical education and experts in social determinants of health) on which aspects of the topic could be taught during undergraduate versus graduate medical education. METHODS: A modified Delphi method was used to generate expert consensus on which learning objectives of social determinants of health are best taught at each stage of medical education. Delphi respondents included experts in medical education or social determinants of health. A survey was created using nationally published criteria for social determinants of health learning objectives. Respondents were asked 1) which learning objectives were necessary for every physician (irrespective of specialty) to develop competence upon completion of medical training and 2) when the learning objective should be taught. Respondents were also asked an open-ended question on how they made the determination of when in the medical education continuum the learning objective should be taught. RESULTS: 26 out of 55 experts (13 social determinants of health and 13 education experts) responded to all 3 Delphi rounds. Experts evaluated a total of 49 learning objectives and were able to achieve consensus for at least one of the two research questions for 45 of 49 (92%) learning objectives. 50% more learning objectives reached consensus for inclusion in undergraduate (n = 21) versus graduate medical education (n = 14). CONCLUSIONS: A modified Delphi technique demonstrated that experts could identify key learning objectives of social determinants of health needed by all physicians and allocate content along the undergraduate and graduate medical education continuum. This approach could serve as a model for similar socio-cultural content. Future work should employ a qualitative approach to capture principles utilized by experts when making these decisions.

Time Given to Trainees to Attempt Cannulation During Endoscopic Retrograde Cholangiopancreatography Varies by Training Program and Is Not Associated With Competence.

Advanced endoscopy training programs (AETPs) were developed as a result of the lack of comprehensive endoscopic retrograde cholangiopancreatography (ERCP) training during gastroenterology fellowships. There is no standardized curriculum for AETPs and the influence of program- and trainer-associated factors on trainee competence in ERCP has not been investigated adequately. In prior work, we showed that advanced endoscopy trainees (AETs) achieve ERCP competence at varying rates.1,2 The aims of this study were to measure the variability in time given to AETs to attempt cannulation between AETPs and throughout the 1-year training period, and to determine the association between AET cannulation time and AET competence at the end of training.

Effect of individualized feedback on learning curves in EGD and colonoscopy: a cluster randomized controlled trial.

BACKGROUND AND AIMS: Gastroenterology fellowships need to ensure that trainees achieve competence in upper endoscopy (EGD) and colonoscopy. Because the impact of structured feedback remains unknown in endoscopy training, this study compared the effect of structured feedback with standard feedback on trainee learning curves for EGD and colonoscopy. METHODS: In this multicenter, cluster, randomized controlled trial, trainees received either individualized quarterly learning curves or feedback standard to their fellowship. Assessment was performed in all trainees using the Assessment of Competency in Endoscopy tool on 5 consecutive procedures after every 25 EGDs and colonoscopies. Individual learning curves were created using cumulative sum (CUSUM) analysis. The primary outcome was the mean CUSUM score in overall technical and overall cognitive skills. RESULTS: In all, 13 programs including 132 trainees participated. The intervention arm (6 programs, 51 trainees) contributed 558 EGD and 600 colonoscopy assessments. The control arm (7 programs, 81 trainees) provided 305 EGD and 468 colonoscopy assessments. For EGD, the intervention arm (-.7 [standard deviation {SD}, 1.3]) had a superior mean CUSUM score in overall cognitive skills compared with the control arm (1.6 [SD, .8], P = .03) but not in overall technical skills (intervention, -.26 [SD, 1.4]; control, 1.76 [SD, .7]; P = .06). For colonoscopy, no differences were found between the 2 arms in overall cognitive skills (intervention, -.7 [SD, 1.3]; control, .7 [SD, 1.3]; P = .95) or overall technical skills (intervention, .1 [SD, 1.5]; control, -.1 [SD, 1.5]; P = .77). CONCLUSIONS: Quarterly feedback in the form of individualized learning curves did not affect learning curves for EGD and colonoscopy in a clinically meaningful manner. (Clinical trial registration number: NCT02891304.).

A BEME realist synthesis review of the effectiveness of teaching strategies used in the clinical setting on the development of clinical skills among health professionals: BEME Guide No. 61.

Background: Literature describing the effectiveness of teaching strategies in the clinical setting is limited. This realist synthesis review focuses on understanding the effectiveness of teaching strategies used in the clinical setting.Methods: We searched ten databases for English language publications between 1 January 1970 and 31 May 2017 reporting effective teaching strategies, used in a clinical setting, of non-procedural skills. After screening, we used consensus to determine inclusion and employed a standardised instrument to capture study populations, methodology, and outcomes. We summarised what strategies worked, for whom, and in what settings.Results: The initial search netted 53,642 references after de-duplication; 2037 were retained after title and abstract review. Full text review was done on 82 references, with ultimate inclusion of 25 publications. Three specific teaching strategies demonstrated impact on educational outcomes: the One Minute Preceptor (OMP), SNAPPS, and concept mapping. Most of the literature involves physician trainees in an ambulatory environment. All three have been shown to improve skills in the domains of medical knowledge and clinical reasoning.Discussion/conclusions: Apart from the OMP, SNAPPS, and concept mapping, which target the formation of clinical knowledge and reasoning skills, the literature establishing effective teaching strategies in the clinical setting is sparse.

Competence in Endoscopic Ultrasound and Endoscopic Retrograde Cholangiopancreatography, From Training Through Independent Practice.

BACKGROUND & AIMS: It is unclear whether participation in competency-based fellowship programs for endoscopic ultrasound (EUS) and endoscopic retrograde cholangiopancreatography (ERCP) results in high-quality care in independent practice. We measured quality indicator (QI) adherence during the first year of independent practice among physicians who completed endoscopic training with a systematic assessment of competence. METHODS: We performed a prospective multicenter cohort study of invited participants from 62 training programs. In phase 1, 24 advanced endoscopy trainees (AETs), from 20 programs, were assessed using a validated competence assessment tool. We used a comprehensive data collection and reporting system to create learning curves using cumulative sum analysis that were shared with AETs and trainers quarterly. In phase 2, participating AETs entered data into a database pertaining to every EUS and ERCP examination during their first year of independent practice, anchored by key QIs. RESULTS: By the end of training, most AETs had achieved overall technical competence (EUS 91.7%, ERCP 73.9%) and cognitive competence (EUS 91.7%, ERCP 94.1%). In phase 2 of the study, 22 AETs (91.6%) participated and completed a median of 136 EUS examinations per AET and 116 ERCP examinations per AET. Most AETs met the performance thresholds for QIs in EUS (including 94.4% diagnostic rate of adequate samples and 83.8% diagnostic yield of malignancy in pancreatic masses) and ERCP (94.9% overall cannulation rate). CONCLUSIONS: In this prospective multicenter study, we found that although competence cannot be confirmed for all AETs at the end of training, most meet QI thresholds for EUS and ERCP at the end of their first year of independent practice. This finding affirms the effectiveness of training programs. Clinicaltrials.gov ID NCT02509416.

A Guide for Increasing Scholarship for Medical Educators.

Disseminating scholarly work as a clinician educator is critical to furthering new knowledge in medical education, creating an evidence base for new practices, and increasing the likelihood of promotion. Knowing how to initiate scholarship and develop habits to support it, however, may not be clear. This perspective is designed to help readers choose and narrow their focus of scholarly interest, garner mentors, find potential project funding, and identify outside support through involvement with national organizations, collaborators, and faculty development programs. By incorporating these suggestions into their daily work, educators can find ways to connect their clinical and educational interests and make their daily work count toward scholarship.

Setting minimum standards for training in EUS and ERCP: results from a prospective multicenter study evaluating learning curves and competence among advanced endoscopy trainees.

BACKGROUND AND AIMS: Minimum EUS and ERCP volumes that should be offered per trainee in "high quality" advanced endoscopy training programs (AETPs) are not established. We aimed to define the number of procedures required by an "average" advanced endoscopy trainee (AET) to achieve competence in technical and cognitive EUS and ERCP tasks to help structure AETPs. METHODS: American Society for Gastrointestinal Endoscopy (ASGE)-recognized AETPs were invited to participate; AETs were graded on every fifth EUS and ERCP examination using a validated tool. Grading for each skill was done using a 4-point scoring system, and learning curves using cumulative sum analysis for overall, technical, and cognitive components of EUS and ERCP were shared with AETs and trainers quarterly. Generalized linear mixed-effects models with a random intercept for each AET were used to generate aggregate learning curves, allowing us to use data from all AETs to estimate the average learning experience for trainees. RESULTS: Among 62 invited AETPs, 37 AETs from 32 AETPs participated. Most AETs reported hands-on EUS (52%, median 20 cases) and ERCP (68%, median 50 cases) experience before starting an AETP. The median number of EUS and ERCPs performed per AET was 400 (range, 200-750) and 361 (range, 250-650), respectively. Overall, 2616 examinations were graded (EUS, 1277; ERCP-biliary, 1143; pancreatic, 196). Most graded EUS examinations were performed for pancreatobiliary indications (69.9%) and ERCP examinations for ASGE biliary grade of difficulty 1 (72.1%). The average AET achieved competence in core EUS and ERCP skills at approximately 225 and 250 cases, respectively. However, overall technical competence was achieved for grade 2 ERCP at about 300 cases. CONCLUSION: The thresholds provided for an average AET to achieve competence in EUS and ERCP may be used by the ASGE and AETPs in establishing the minimal standards for case volume exposure for AETs during their training. (Clinical trial registration number: NCT02509416.).

Development of a neonatal curriculum for medical students in Zimbabwe - a cross sectional survey.

BACKGROUND: Calls have been made to reassess the curricula of medical schools throughout the world to adopt competence-based programs that address the healthcare needs of society. Zimbabwe is a country characterized by a high neonatal mortality rate of 24 per 1000 live births. The current research sought to determine the content and appropriate teaching strategies needed to guide the development of an undergraduate neonatal curriculum map for medical students at the University of Zimbabwe College of Health Sciences. METHODS: We surveyed faculty (n = 8) and non-faculty pediatricians (n = 5), senior resident medical officers (N = 26) using a self-administered questionnaire, and completed one focus group discussion with midwives (n = 11). We asked respondents their expectations regarding knowledge, psychomotor skills, competencies, and teaching strategies in a basic newborn curriculum for medical students. Relevant policy and curricula documents were reviewed to assess newborn health needs and the current training. A group of faculty educationists (n = 11) collated and finalized the findings from the document review, survey, and focus group using descriptive statistics and thematic analysis. RESULTS: The document review revealed three key neonatal health objectives according to the current national maternal and neonatal health road map. These objectives are to be met using a four tier approach comprising (i) family planning (ii) focused antenatal care (iii) clean and safe delivery and (iv) basic and comprehensive emergency obstetric & neonatal care. Existing curriculum has 15 newborn topics taught in lecture style during the pediatric rotations, and five newborn care skills to be learned through observation. The existing curriculum is silent on desired competencies. In the current study 19 cognitive areas, 17 psychomotor skills and six competency domains were identified for an ideal neonatal curriculum for undergraduate students. A combination of teaching strategies including classroom, simulation and a clinical rotation were recommended. CONCLUSION: This study revealed a significant gap between the existing neonatal curriculum and the ideal curriculum as recommended by broad stakeholders in the context of national health care needs. Next steps are to complete the development and implementation of the proposed curriculum map to better align with the ideal state.

The SGIM TEACH Program: A Curriculum for Teachers of Clinical Medicine.

BACKGROUND: Demand for faculty with teaching expertise is increasing as medical education is becoming well established as a career pathway. Junior faculty may be expected to take on teaching responsibilities with minimal training in teaching skills. AIM: To address the faculty development needs of junior clinician-educators with teaching responsibilities and those changing their career focus to include teaching. SETTING: Sessions at two Society of General Internal Medicine (SGIM) annual meetings combined with local coaching and online learning during the intervening year. PARTICIPANTS: Eighty-nine faculty scholars in four consecutive annual cohorts from 2013 to 2016. PROGRAM DESCRIPTION: Scholars participate in a full-day core teaching course as well as selective workshops at the annual meetings. Between meetings they receive direct observation and feedback on their teaching from a local coach and participate in an online discussion group. PROGRAM EVALUATION: Sessions were evaluated using a post-session survey. Overall content rating was 4.48 (out of 5). Eighty-nine percent of participants completed all requirements. Of these, 100% agreed that they had gained valuable knowledge and skills. DISCUSSION: The TEACH certificate program provides inexperienced faculty teachers an opportunity to develop core skills. Satisfaction is high. Future research should focus on the impact that this and similar programs have on teaching skills.

Attending rounds: What do the all-star teachers do?

AIM: To examine differences in the types of teaching activities performed during rounds between the most effective and least effective inpatient teaching attendings. METHODS: Participants included 56 attending physicians supervising 279 trainees. Trained observers accompanied teams during rounds and recorded the frequencies of educational activities that occurred. Students and residents then rated their satisfaction with the teaching on rounds. RESULTS: Attending physicians with the highest learner satisfaction scores performed significantly more teaching activities per patient than attending physicians who were rated as average or less-effective (2.1 vs. 1.4 vs. 1.5; p = .03). There were significant differences in the frequencies of 3 out of the 9 specific teaching activities observed, including answering specific patient-care related questions (77% vs. 66% vs. 47%; p = .003), teaching on learner chosen topics (8% vs. 2% vs. 2%; p = .02), and providing feedback (31% vs. 10% vs. 0.1%; p = .001). CONCLUSIONS: Specific categories of teaching activities-patient-specific teaching, teaching on learner-identified topics, and providing real-time feedback-are performed more frequently by the highest-rated attending physicians, which can guide faculty development.

The effect of resident duty-hours restrictions on internal medicine clerkship experiences: surveys of medical students and clerkship directors.

UNLABELLED: PHENOMENON: Medical students receive much of their inpatient teaching from residents who now experience restructured teaching services to accommodate the 2011 duty-hour regulations (DHR). The effect of DHR on medical student educational experiences is unknown. We examined medical students' and clerkship directors' perceptions of the effects of the 2011 DHR on internal medicine clerkship students' experiences with teaching, feedback and evaluation, and patient care. APPROACH: Students at 14 institutions responded to surveys after their medicine clerkship or subinternship. Students who completed their clerkship (n = 839) and subinternship (n = 228) March to June 2011 (pre-DHR historical controls) were compared to clerkship students (n = 895) and subinterns (n = 377) completing these rotations March to June 2012 (post-DHR). Z tests for proportions correcting for multiple comparisons were performed to assess attitude changes. The Clerkship Directors in Internal Medicine annual survey queried institutional members about the 2011 DHR just after implementation. FINDINGS: Survey response rates were 64% and 50% for clerkship students and 60% and 48% for subinterns in 2011 and 2012 respectively, and 82% (99/121) for clerkship directors. Post-DHR, more clerkship students agreed that attendings (p =.011) and interns (p =.044) provided effective teaching. Clerkship students (p =.013) and subinterns (p =.001) believed patient care became more fragmented. The percentage of holdover patients clerkship students (p =.001) and subinterns (p =.012) admitted increased. Clerkship directors perceived negative effects of DHR for students on all survey items. Most disagreed that interns (63.1%), residents (67.8%), or attendings (71.1%) had more time to teach. Most disagreed that students received more feedback from interns (56.0%) or residents (58.2%). Fifty-nine percent felt that students participated in more patient handoffs. INSIGHTS: Students perceive few adverse consequences of the 2011 DHR on their internal medicine experiences, whereas their clerkship director educators have negative perceptions. Future research should explore the impact of fragmented patient care on the student-patient relationship and students' clinical skills acquisition.

Methods and outcomes for the remediation of clinical reasoning.

INTRODUCTION: There is no widely accepted structured, evidence based strategy for the remediation of clinical reasoning skills. AIM: To assess the effectiveness of a standardized clinical reasoning remediation plan for medical learners at various stages of training. SETTING: Learners enrolled in the University of Colorado School of Medicine Remediation Program. PROGRAM DESCRIPTION: From 2006 to 2012, the learner remediation program received 151 referrals. Referrals were made by medical student clerkship directors, residency and fellowship program directors, and through self-referrals. Each learner's deficiencies were identified using a standardized assessment process; 53 were noted to have clinical reasoning deficits. The authors developed and implemented a ten-step clinical reasoning remediation plan for each of these individuals, whose subsequent performance was independently assessed by unbiased faculty and senior trainees. Participant demographics, faculty time invested, and learner outcomes were tracked. PROGRAM EVALUATION: Prevalence of clinical reasoning deficits did not differ by level of training of the remediating individual (p = 0.49). Overall, the mean amount of faculty time required for remediation was 29.6 h (SD = 29.3), with a median of 18 h (IQR 5-39) and a range of 2-100 h. Fifty-one of the 53 (96%) passed the post remediation reassessment. Thirty-eight (72%) learners either graduated from their original program or continue to practice in good standing. Four (8%) additional residents who were placed on probation and five (9%) who transferred to another program have since graduated. DISCUSSION: The ten-step remediation plan proved to be successful for the majority of learners struggling with clinical reasoning based on reassessment and limited subsequent educational outcomes. Next steps include implementing the program at other institutions to assess generalizability and tracking long-term outcomes on clinical care.

Failure to fail: the institutional perspective.

PURPOSE: To determine institutional barriers to placing failing students on probation, dismissing students. METHODS: An online survey study was distributed to Student Affairs Deans or the equivalent at allopathic (MD) and osteopathic (DO) medical schools, and physician assistant (PA) and nurse practitioner (NP) schools across the United States. Nineteen (40%) of the 48 schools responded: six MD, four DO, five PA and four NP. The survey contained demographic questions and questions regarding probation and dismissal. Themes were independently coded and combined via consensus based on grounded theory. The survey was distributed until saturation of qualitative responses were achieved. RESULTS: Respondents identified variations in the use of probation and dismissal and a wide range of barriers, with the greatest emphasis on legal concerns. Respondents felt that students were graduating who should not be allowed to graduate, and that the likelihood of a student being placed on probation or being terminated was highly variable. DISCUSSION: Our results suggest that institution culture at heath professions schools across the United States may represent an obstacle in placing failing learners on probation and dismissing learners who should not graduate. Additional studies are needed to prove if these concerns are founded or merely fears.

Feasibility and sustainability of an interactive team-based learning method for medical education during a severe faculty shortage in Zimbabwe.

BACKGROUND: In 2010, in the midst of the human immunodeficiency virus (HIV) epidemic in Zimbabwe, 69% of faculty positions in the Department of Medicine of the University of Zimbabwe College of Health Sciences (UZ-CHS) were vacant. To address the ongoing need to train highly skilled HIV clinicians with only a limited number of faculty, we developed and implemented a course for final-year medical students focused on HIV care using team-based learning (TBL) methods. METHODS: A competency-based HIV curriculum was developed and delivered to final-year medical students in 10 TBL sessions as part of a 12 week clinical medicine attachment. A questionnaire was administered to the students after completion of the course to assess their perception of TBL and self-perceived knowledge gained in HIV care. Two cohorts of students completed the survey in separate academic years, 2011 and 2012. Descriptive analysis of survey results was performed. RESULTS: Ninety-six of 120 students (80%) completed surveys. One hundred percent of respondents agreed that TBL was an effective way to learn about HIV and 66% strongly agreed. The majority of respondents agreed that TBL was more stimulating than a lecture course (94%), fostered enthusiasm for the course material (91%), and improved teamwork (96%). Students perceived improvements in knowledge gained across all of the HIV subjects covered, especially in challenging applied clinical topics, such as management of HIV antiretroviral failure (88% with at least a "large improvement") and HIV-tuberculosis co-infection (80% with at least a "large improvement"). CONCLUSIONS: TBL is feasible as part of medical education in an African setting. TBL is a promising way to teach challenging clinical topics in a stimulating and interactive learning environment in a low-income country setting with a high ratio of students to teachers.