Making sense of competency-based medical education (CBME) literary conversations: A BEME scoping review: BEME Guide No. 78.

BACKGROUND: Competency-based medical education (CBME) received increased attention in the early 2000s by educators, clinicians, and policy makers as a way to address concerns about physician preparedness and patient safety in a rapidly changing healthcare environment. Opinions and perspectives around this shift in medical education vary and, to date, a systematic search and synthesis of the literature has yet to be undertaken. The aim of this scoping review is to present a comprehensive map of the literary conversations surrounding CBME. METHODS: Twelve different databases were searched from database inception up until 29 April 2020. Literary conversations were extracted into the following categories: perceived advantages, perceived disadvantages, challenges/uncertainties/skepticism, and recommendations related to CBME. RESULTS: Of the 5757 identified records, 387 were included in this review. Through thematic analysis, eight themes were identified in the literary conversations about CBME: credibility, application, community influence, learner impact, assessment, educational developments, organizational structures, and societal impacts of CBME. Content analysis supported the development of a heat map that provides a visual illustration of the frequency of these literary conversations over time. CONCLUSIONS: This review serves two purposes for the medical education research community. First, this review acts as a comprehensive historical record of the shifting perceptions of CBME as the construct was introduced and adopted by many groups in the medical education global community over time. Second, this review consolidates the many literary conversations about CBME that followed the initial proposal for this approach. These findings can facilitate understanding of CBME for multiple audiences both within and outside of the medical education research community.

Ready, set, go! Evaluating readiness to implement competency-based medical education.

PURPOSE: Organizational readiness is critical for successful implementation of an innovation. We evaluated program readiness to implement Competence by Design (CBD), a model of Competency-Based Medical Education (CBME), among Canadian postgraduate training programs. METHODS: A survey of program directors was distributed 1 month prior to CBD implementation in 2019. Questions were informed by the R = MC2 framework of organizational readiness and addressed: program motivation, general capacity for change, and innovation-specific capacity. An overall readiness score was calculated. An ANOVA was conducted to compare overall readiness between disciplines. RESULTS: Survey response rate was 42% (n = 79). The mean overall readiness score was 74% (30-98%). There was no difference in scores between disciplines. The majority of respondents agreed that successful implementation of CBD was a priority (74%), and that their leadership (94%) and faculty and residents (87%) were supportive of change. Fewer perceived that CBD was a move in the right direction (58%) and that implementation was a manageable change (53%). Curriculum mapping, competence committees and programmatic assessment activities were completed by >90% of programs, while <50% had engaged off-service disciplines. CONCLUSION: Our study highlights important areas where programs excelled in their preparation for CBD, as well as common challenges that serve as targets for future intervention to improve program readiness for CBD implementation.

Implementation of competence committees during the transition to CBME in Canada: A national fidelity-focused evaluation.

PURPOSE: This study evaluated the fidelity of competence committee (CC) implementation in Canadian postgraduate specialist training programs during the transition to competency-based medical education (CBME). METHODS: A national survey of CC chairs was distributed to all CBME training programs in November 2019. Survey questions were derived from guiding documents published by the Royal College of Physicians and Surgeons of Canada reflecting intended processes and design. RESULTS: Response rate was 39% (113/293) with representation from all eligible disciplines. Committee size ranged from 3 to 20 members, 42% of programs included external members, and 20% included a resident representative. Most programs (72%) reported that a primary review and synthesis of resident assessment data occurs prior to the meeting, with some data reviewed collectively during meetings. When determining entrustable professional activity (EPA) achievement, most programs followed the national specialty guidelines closely with some exceptions (53%). Documented concerns about professionalism, EPA narrative comments, and EPA entrustment scores were most highly weighted when determining resident progress decisions. CONCLUSIONS: Heterogeneity in CC implementation likely reflects local adaptations, but may also explain some of the variable challenges faced by programs during the transition to CBME. Our results offer educational leaders important fidelity data that can help inform the larger evaluation and transformation of CBME.

Twelve tips for learners to succeed in a CBME program.

The international movement to competency-based medical education (CBME) marks a major transition in medical education that requires a shift in educators' and learners' approach to clinical experiences, the way assessment data are collected and integrated, and in learners' mindsets. Learners entering a CBME curriculum must actively drive their learning experiences and education goals. For some, this expectation may be a significant change from their previous approach to learning in medicine. This paper highlights 12 tips to help learners succeed within a CBME model.

Diagnosing conflict: Conflicting data, interpersonal conflict, and conflicts of interest in clinical competency committees.

Clinical competency committees (CCCs) are increasingly used within health professions education as their decisions are thought to be more defensible and fairer than those generated by previous training promotion processes. However, as with most group-based processes, it is inevitable that conflict will arise. In this paper the authors explore three ways conflict may arise within a CCC: (1) conflicting data submissions that are presented to the committee, (2) conflicts between members of the committee, and (3) conflicts of interest between a specific committee member and a trainee. The authors describe each of these conflict situations, dissect out the underlying problems, and explore possible solutions based on the current literature.

Key considerations in planning and designing programmatic assessment in competency-based medical education.

Programmatic assessment as a concept is still novel for many in clinical education, and there may be a disconnect between the academics who publish about programmatic assessment and the front-line clinical educators who must put theory into practice. In this paper, we clearly define programmatic assessment and present high-level guidelines about its implementation in competency-based medical education (CBME) programs. The guidelines are informed by literature and by lessons learned from established programmatic assessment approaches. We articulate five steps to consider when implementing programmatic assessment in CBME contexts: articulate the purpose of the program of assessment, determine what must be assessed, choose tools fit for purpose, consider the stakes of assessments, and define processes for interpreting assessment data. In the process, we seek to offer a helpful guide or template for front-line clinical educators. We dispel some myths about programmatic assessment to help training programs as they look to design-or redesign-programs of assessment. In particular, we highlight the notion that programmatic assessment is not 'one size fits all'; rather, it is a system of assessment that results when shared common principles are considered and applied by individual programs as they plan and design their own bespoke model of programmatic assessment for CBME in their unique context.

Patterns of performance in students with frequent low stakes team based learning assessments: Do students change behavior?

Team-based learning offers an active learning strategy that provides a structure for measurement of learning and feedback to the students. Aggregating these results provides a longitudinal pattern of student performance. In this study, we analyzed results from a sequence of assessments related to TBL IRAT and GRAT assessments and traditional quizzes in a second-year musculoskeletal course in an undergraduate medical education program to determine if there are any measurable patterns, or performance trends, that students demonstrate in the course. Analyzing results from four academic years, we found evidence supporting there is predictability in student's future week's performance based on past performances across teaching modalities. We hypothesize that students are moderating their own effort regarding weekly low-stake assessments in prioritizing their academic efforts. The results from this study highlight the role of self-efficacy in medical education and suggest a new area of research for assessment of student performance patterns. Future studies could investigate whether these performance patterns are replicated in other assessment modalities and whether the same pattern holds for high-stakes assessments.

The use of BEME reviews in the medical education literature.

INTRODUCTION: Knowledge syntheses in medical education are intended to promote the translation to, and mobilization of, research knowledge into practice. Despite the effort invested in conducting them, how these knowledge syntheses are used is unclear. This study aimed to explore how knowledge syntheses published by the Best Evidence Medical Education Collaboration (BEME) have been used in a cross-section of published literature. METHODS: Citation patterns for BEME reviews were explored using data drawn from Web of Science and Scopus, and a sub-sample of citing papers. RESULTS: Bibliometric data on 3419 papers citing 29 BEME reviews were analysed. More detailed data were extracted from a random sample of 629 full-text papers. DISCUSSION: BEME reviews were most often positioned to consolidate and summarize the current state of knowledge on a particular topic and to identify gaps in the literature; they were also used to justify current research, and less frequently to contextualize and explain results, or direct future areas of research. Their use to identify instruments or methodological approaches was relatively absent. CONCLUSION: While BEME reviews are primarily used to justify and support other studies, the current literature does not demonstrate their translation to educational practice.

Training disrupted: Practical tips for supporting competency-based medical education during the COVID-19 pandemic.

The COVID-19 pandemic has disrupted healthcare systems around the world, impacting how we deliver medical education. The normal day-to-day routines have been altered for a number of reasons, including changes to scheduled training rotations, physical distancing requirements, trainee redeployment, and heightened level of concern. Medical educators will likely need to adapt their programs to maximize learning, maintain effective care delivery, and ensure competent graduates. Along with a continued focus on learner/faculty wellness, medical educators will have to optimize existing training experiences, adapt those that are no longer viable, employ new technologies, and be flexible when assessing competencies. These practical tips offer guidance on how to adapt medical education programs within the constraints of the pandemic landscape, stressing the need for communication, innovation, collaboration, flexibility, and planning within the era of competency-based medical education.

Patient-centred education: How do learners' perceptions change as they experience clinical training?

The use of patient educators is one of many teaching strategies meant to foster principles of patient-centred care. We previously found that early patient educator exposure helped to shape the understanding of patient-centredness in pre-clerkship learners. We now expand on this work to evaluate whether there is persistence of initial perceptions and to explore general reflections on longer-term impacts of early patient educator exposures once learners are immersed in the clinical phase of their training. In this follow-up study, we conducted group interviews with a sample of learners who wrote reflections as part of their pre-clerkship patient educator experience. We explored how perspectives on patient educators changed over time, and determined which themes identified during pre-clerkship remained relevant to clinical trainees. Audio recordings were transcribed and analyzed thematically using a hybrid inductive and deductive analysis to construct a thematic framework derived through a method of constant comparison. We identified three new themes: "value of early clinical experience", "change in learners' perspectives", and "valuing and applying CanMEDS roles other than Medical Expert". Themes from pre-clerkship that remained relevant included: "patients' perspective humanizes disease", "patients' experiences with navigating the healthcare system", "learners' perceptions of the learning strategy", and "inaccuracies and inconsistencies in the learning experience." Many themes identified in pre-clerkship learners remain relevant in early clinical trainees. Further, insights from pre-clerkship experiences with patient educators evolve as learners experience clerkship with definite shifts in emphasis and new perspectives. This work illuminates the utility of patient educators for those considering this strategy for supporting the development of patient-centredness in undergraduate medical education.

The roles of basic psychological needs, self-compassion, and self-efficacy in the development of mastery goals among medical students.

Aim: Competency-based medical education aims to foster mastery goals in learners. We examined medical students' mastery approach (beneficial) and mastery avoidance (maladaptive) goals and their associations with students' basic psychological needs, self-compassion, and self-efficacy. Methods: This was a cross-sectional study employing an online questionnaire. Two hundred medical students in all four years of the medical program completed the questionnaire, containing measures of mastery goals, basic psychological needs (autonomy, competence, relatedness), self-compassion, and self-efficacy. Regression analyses were performed. Results: Of the three basic psychological needs, the need for competence was significant in explaining both types of mastery goals. Self-efficacy and self-compassion were significant in explaining mastery approach and mastery avoidance goals, respectively. Conclusions: Creating learning environments that are supportive of students' need for competence, raising students' awareness of the value of learning from mistakes in competency acquisition, and providing opportunities for students to experience self-efficacy may foster beneficial mastery approach goals in medical students.

Medical student well-being and lifelong learning: A motivational perspective.

Background: Medical school poses many pressures and challenges for individuals aspiring to health careers. Only some students, however, experience high stress and exhaustion, whereas others adaptively respond to schooling demands and engage in lifelong learning practices. By drawing on three motivation theories - self-determination theory, self-theories of ability, and achievement goal theory - this study examined the relations among motivational constructs, stress, exhaustion, and lifelong learning in medical students. Methods: All medical students in a 4-year program were invited to complete a questionnaire containing measures of psychological need satisfaction, self-theories of ability, achievement goals, stress, exhaustion, lifelong learning, and background characteristics. Using structural equation modeling, we tested a structural model that combined the three motivation theories to explain stress, exhaustion, and lifelong learning in medical students. Results: A total of 267 medical students participated in the study (response rate 42%). The results largely confirmed the hypothesized relations, revealing that unmet psychological needs and a fixed mind-set were associated with maladaptive cognitions (i.e., the pursuit of avoidance goals) and psychological distress (i.e., high stress and exhaustion). In contrast, psychological need satisfaction and a growth mind-set had distinct pathways to beneficial cognitions (i.e., mastery approach goals) and lifelong learning practices in medical students. Discussion: Adaptive motivations, cultivated through personal and environmental factors, may help to protect medical students from psychological distress and enhance their growth as lifelong learners. Understanding the mechanisms and pathways to desirable and undesirable outcomes in medical students is critical for creating learning environments that will serve these students well.

What are the features of targeted or system-wide initiatives that affect diversity in health professions trainees? A BEME systematic review: BEME Guide No. 50.

BACKGROUND/PURPOSE: There is interest to increase diversity among health professions trainees. This study aims to determine the features/effects of interventions to promote recruitment/admission of under-represented minority (URM) students to health professions programs. METHODOLOGY: This registered BEME review applied systematic methods to: title/full-text inclusion review, data extraction, and quality assessment (QA). Included studies reported outcomes for interventions designed to increase diversity of health professions education (HPE) programs' recruitment and admissions. RESULTS: Of 7225 studies identified 86 met inclusion criteria. Interventions addressed: admissions (34%), enrichment (19%), outreach (15%), curriculum (3%), and mixed (29%). They were mostly single center (76%), from the United States (81%), in medicine (45%) or dentistry (22%). URM definition was stated in only 24%. The dimension most commonly considered was ethnicity/race (88%). The majority of studies (81%) found positive effects. Heterogeneity precluded meta-analysis. Qualitative analysis identified key features: admissions studies points systems and altered weightings; enrichment studies highlighted academic, application and exam preparation, and workplace exposure. DISCUSSION/CONCLUSIONS: Several intervention types may increase diversity. Limited applicant pools were a rate-limiting feature, suggesting efforts earlier in the continuum are needed to broaden applicant pools. There is a need to examine underlying cultural and external pressures that limit programs' acceptance of initiatives to increase diversity.

At the precipice: a prospective exploration of medical students' expectations of the pre-clerkship to clerkship transition.

Medical learners face many challenging transitions. We prospectively explored students' perceptions of their upcoming transition to clerkship and their future professional selves. In 2013, 160/165 end-of-second-year medical students wrote narrative reflections and 79/165 completed a questionnaire on their perceptions of their upcoming transition to clerkship. Narratives were separately analyzed by four authors and then discussed to identify a final thematic framework using parsimonious category construction. We identified two overarching themes: (1) "Looking back": experiences which had helped students feel prepared for clerkship with subthemes focused on of patient care, shadowing, classroom teaching and the pre-clerkship years as foundational knowledge, (2) "Looking forward": anticipating the clerkship experience and the journey of becoming a physician with subthemes focused on death and dying, hierarchy, work-life balance, interactions with patients, concerns about competency and career choice. Questionnaire data revealed incongruities around expectations of minimal exposure to death and dying, little need for independent study and limited direct patient responsibility. We confirmed that internal transformations are happening in contemplative time even before clerkship. By prospectively exploring pre-clerkship students' perceptions of the transition to clerkship training we identified expectations and misconceptions that could be addressed with future curricular interventions. While students are aware of and anticipating their learning needs it is not as clear that they realise how much their future learning will depend on their own inner resources. We suggest that more attention be paid to professional identity formation and the development of the physician as a person during these critical transitions.

Building capacity for education research among clinical educators in the health professions: A BEME (Best Evidence Medical Education) Systematic Review of the outcomes of interventions: BEME Guide No. 34.

BACKGROUND/PURPOSE: There is a growing desire for health professions educators to generate high-quality education research; yet, few of them encounter the training to do so. In response, health professions faculties have increasingly been devoting resources to provide members with the skills necessary for education research. The form and impact of these efforts have not been reviewed, though such a synthesis could be useful for practice. The objectives of this systematic review were to (1) identify interventions aimed at building capacity for education research among health professions clinical educators and (2) review the outcomes of these interventions. METHODOLOGY: We developed a systematic review protocol based on our pilot scoping search. This protocol underwent peer review and was prospectively registered with the Best Evidence Medical Education Collaboration. Based on this protocol, we conducted a comprehensive search of health professions' databases and related grey literature. Systematic methods were applied: two independent reviewers completed title screening and full text review for inclusion, data extraction, and methodological quality assessment. Studies were included if they reported outcomes for interventions designed to increase capacity for health professions clinical educators to conduct education research. We conducted a qualitative synthesis of the evidence which included detailed reporting of intervention characteristics and outcomes. RESULTS: Our search returned 14, 149 results, 241 of which were retained after title and abstract screening, and 30 of which met inclusion criteria after full text review. Seven groups of interventions were identified, the most frequent being teaching scholars programs (n = 10), health professions education fellowships (n = 3) or master's programs (n = 4). The most commonly measured outcome was change related to enhanced scholarly outputs (grants, papers, abstracts, and presentations) post-intervention. Unfortunately, most of the included studies lacked detailed description of the intervention and were of low to moderate quality with post-test only design. DISCUSSION/CONCLUSIONS: This review demonstrates that various interventions can have a positive impact on the ability of health professions clinical educators to conduct education research. We note several key elements of the interventions including: (1) protected time, (2) mentorship and/or collaboration, (3) departmental and institutional commitment and leadership, and (4) financial support. Through our analysis we describe the complexities around evaluating clinical educators' health professions research activities and the interventions used to promote education research. While improved study quality would allow more detailed understanding and evaluation of these key features, we are able to provide recommendations for potential strategies for improving participation in and quality of health professions education research based on this analysis.

Patient-centred education: what do students think?

CONTEXT: Medical educators endeavour to foster patient-centred learning. Although studies of patient-educators report general increases in patient-centredness, no formal review of students' reflections on the role of patients in their education has yet been undertaken. Our research questions were: (i) What themes might be identified through a qualitative analysis of students' reflective writing on patient-centred education? (ii) What are common students' perceptions regarding patients as educators? METHODS: For two academic years, Year 2 pre-clinical students (189 and 167 students, respectively, in each academic year) submitted a 250-word writing assignment in response to one of four questions meant to promote reflection on the role of patients in their education. Using a grounded theory approach, we performed a qualitative analysis of these written reflections for emerging themes. A synthesis of these themes was prepared and was presented for validation and discussion by two focus groups of six and three students, respectively. We analysed the transcripts of the focus group discussions and compared them with results from the analysis of written reflections and used them to further inform and refine our initial thematic framework. RESULTS: A total of 356 reflective writing assignments were analysed. The major themes were: (i) students seeing the condition within the context of patients' lives; (ii) patients supporting students' learning; (iii) students recognising patients' needs; (iv) students seeing the patient as a capable part of the team, and (v) students recognising the complexity of practising medicine. The two focus group discussions confirmed these main themes, but placed greater emphasis on the first and second themes. These themes mapped closely to the conceptualisation of patient-centred care defined by the International Alliance of Patients' Organizations. CONCLUSIONS: Students' reflections on their experiences of patient-educators cover an important and broad range of key concepts in patient-centred care that are well aligned with patient-generated conceptualisations of patient-centred care.

Bridging the continuum: Analysis of the alignment of undergraduate and postgraduate accreditation standards.

Several influential national/international bodies including The Bologna Accord, The Carnegie Foundation and The Future of Medical Education in Canada (FMEC) have called for increased coordination across the medical education continuum. FMEC recognizes accreditation as a "powerful lever" and encourages the alignment of undergraduate and postgraduate standards. The Carnegie Foundation includes a similar call for the creation of a more coherent accreditation system. As a first step, using the Canadian context, we present a methodological approach that assesses the example of how well LCME/CACMS undergraduate accreditation standards align with the Royal College of Physician and Surgeons of Canada (RCPSC) postgraduate training standards. We analyzed how closely the 132 LCME/CACMS Medical School accreditation standards aligned with the 155 post-graduate standards from the RCPSC accreditation General Standards (A and B). This comparative evaluation demonstrates that the standards do not align closely. Gaps, redundancies and key differences are highlighted. These results are the first step in understanding how accreditation needs to be adapted and re-aligned across the education continuum to provide consistent and coordinated training and these methods could easily be applied to other contexts and jurisdictions.