Making sense of competency-based medical education (CBME) literary conversations: A BEME scoping review: BEME Guide No. 78.

BACKGROUND: Competency-based medical education (CBME) received increased attention in the early 2000s by educators, clinicians, and policy makers as a way to address concerns about physician preparedness and patient safety in a rapidly changing healthcare environment. Opinions and perspectives around this shift in medical education vary and, to date, a systematic search and synthesis of the literature has yet to be undertaken. The aim of this scoping review is to present a comprehensive map of the literary conversations surrounding CBME. METHODS: Twelve different databases were searched from database inception up until 29 April 2020. Literary conversations were extracted into the following categories: perceived advantages, perceived disadvantages, challenges/uncertainties/skepticism, and recommendations related to CBME. RESULTS: Of the 5757 identified records, 387 were included in this review. Through thematic analysis, eight themes were identified in the literary conversations about CBME: credibility, application, community influence, learner impact, assessment, educational developments, organizational structures, and societal impacts of CBME. Content analysis supported the development of a heat map that provides a visual illustration of the frequency of these literary conversations over time. CONCLUSIONS: This review serves two purposes for the medical education research community. First, this review acts as a comprehensive historical record of the shifting perceptions of CBME as the construct was introduced and adopted by many groups in the medical education global community over time. Second, this review consolidates the many literary conversations about CBME that followed the initial proposal for this approach. These findings can facilitate understanding of CBME for multiple audiences both within and outside of the medical education research community.

Making sense of adaptive expertise for frontline clinical educators: a scoping review of definitions and strategies.

Adaptive expertise has been promoted as an emerging model of expertise in health professions education in response to the inherent complexities of patient care; however, as the concept increasingly influences the structure of professional training and practice, it creates the potential for misunderstandings of the definition and implications of adaptive expertise. To foster a common understanding of the concept, we conducted a scoping review to explore how adaptive expertise has been discussed within health professions education literature. Five databases-MedLine, PubMed, ERIC, CINAHL, and PsycINFO-were searched using the exact term "adaptive expertise", producing 212 unique articles. Fifty-eight articles met inclusion criteria. In the included articles, authors discussed the conceptual implications of adaptive expertise for health professions education, strategies for training for adaptive expertise, and research findings aimed at supporting the development of adaptive expertise or utilizing adaptive expertise as a theoretical framework. The goal of this scoping review is to establish a resource for frontline educators tasked with fostering the development of adaptive expertise in learners through education initiatives. A common understanding of adaptive expertise is essential to ensuring effective implementation in training programs.

Effective competency-based medical education requires learning environments that promote a mastery goal orientation: A narrative review.

PURPOSE: Competency-based medical education (CBME) emphasizes the need for learners to be central to their own learning and to take an active role in learning. This approach has a dual aim: to encourage learners to actively engage in their own learning, and to push learners to develop learning strategies that will prepare them for lifelong learning. This review paper proposes a theoretical bridge between CBME and lifelong learning and puts forth the argument that in order for CBME programs to produce the physicians truly needed in our society now and in the future, learning environments must be intentionally designed to foster mastery goal orientations and to support the development of adaptive self-regulated learning skills and behaviours. MATERIALS AND METHODS: This narrative literature review incorporated results of searches conducted by a subject librarian in PsycInfo and MedLine. Articles were also identified through reference lists of identified papers to capture older key citations. Analysis of the literature used a constructivist epistemological approach to develop an integrative description of the interaction of achievement goal orientation, self-regulated learning, learning environment, and lifelong learning. RESULTS: Findings from achievement goal theory research support the assumption that adoption of a mastery goal orientation facilitates the use of adaptive learning behaviours, such as those described in self-regulated learning theory. Adaptive self-regulated learning strategies, in turn, facilitate effective lifelong learning. The authors offer evidence for how learning environments influence goal orientations and self-regulated learning, and propose that CBME programs intentionally plan for such learning environments. Finally, the authors offer specific suggestions and examples for how learning environments can be designed or adjusted to support adoption of a mastery goal orientation and use of self-regulated learning behaviours and strategies to help support development of adaptive lifelong learners.

Continuity of supervision: Does it mean what we think it means?

CONTEXT: Continuity of supervision (CoS) is generally accepted as an important element of competency-based medical education (CBME). However, collecting and interpreting evidence for its effectiveness are a challenge because we lack a shared understanding of CoS. Translating the available evidence about CoS into practice is an even greater challenge because the evidence largely exists in the undergraduate medical education (UME) literature, whereas literature about CBME is mostly situated in postgraduate medical education (PGME). PROPOSAL: We explore the potential dangers of basing assumptions of the importance of CoS in CBME on evidence from the UME level where CBME is yet to be widely implemented. First, we discuss current understandings of what is meant by CoS and examine some of its evidence and where such evidence comes from. Next, we consider relevant theories related to CoS in the context of CBME and review how it is conceptualised in different educational models. We then discuss some contextual and pedagogical differences between UME and PGME when CoS is considered. Finally, we propose a shared understanding of CoS and outline implications and next steps to determine if the benefits of CoS seen at the UME level will also manifest with PGME learners. CONCLUSIONS: We have the opportunity to undertake research to close our gap in knowledge about CoS at the PGME level using data emerging from our experiences with CBME. Selecting specific dimensions of CoS will allow research that is necessary to determine that what works at the UME level will also work at the PGME level as we continue to march towards CBME.

Key considerations in planning and designing programmatic assessment in competency-based medical education.

Programmatic assessment as a concept is still novel for many in clinical education, and there may be a disconnect between the academics who publish about programmatic assessment and the front-line clinical educators who must put theory into practice. In this paper, we clearly define programmatic assessment and present high-level guidelines about its implementation in competency-based medical education (CBME) programs. The guidelines are informed by literature and by lessons learned from established programmatic assessment approaches. We articulate five steps to consider when implementing programmatic assessment in CBME contexts: articulate the purpose of the program of assessment, determine what must be assessed, choose tools fit for purpose, consider the stakes of assessments, and define processes for interpreting assessment data. In the process, we seek to offer a helpful guide or template for front-line clinical educators. We dispel some myths about programmatic assessment to help training programs as they look to design-or redesign-programs of assessment. In particular, we highlight the notion that programmatic assessment is not 'one size fits all'; rather, it is a system of assessment that results when shared common principles are considered and applied by individual programs as they plan and design their own bespoke model of programmatic assessment for CBME in their unique context.

On the validity of summative entrustment decisions.

Health care revolves around trust. Patients are often in a position that gives them no other choice than to trust the people taking care of them. Educational programs thus have the responsibility to develop physicians who can be trusted to deliver safe and effective care, ultimately making a final decision to entrust trainees to graduate to unsupervised practice. Such entrustment decisions deserve to be scrutinized for their validity. This end-of-training entrustment decision is arguably the most important one, although earlier entrustment decisions, for smaller units of professional practice, should also be scrutinized for their validity. Validity of entrustment decisions implies a defensible argument that can be analyzed in components that together support the decision. According to Kane, building a validity argument is a process designed to support inferences of scoring, generalization across observations, extrapolation to new instances, and implications of the decision. A lack of validity can be caused by inadequate evidence in terms of, according to Messick, content, response process, internal structure (coherence) and relationship to other variables, and in misinterpreted consequences. These two leading frameworks (Kane and Messick) in educational and psychological testing can be well applied to summative entrustment decision-making. The authors elaborate the types of questions that need to be answered to arrive at defensible, well-argued summative decisions regarding performance to provide a grounding for high-quality safe patient care.

Growth mindset in competency-based medical education.

The ongoing adoption of competency-based medical education (CBME) across health professions training draws focus to learner-centred educational design and the importance of fostering a growth mindset in learners, teachers, and educational programs. An emerging body of literature addresses the instructional practices and features of learning environments that foster the skills and strategies necessary for trainees to be partners in their own learning and progression to competence and to develop skills for lifelong learning. Aligned with this emerging area is an interest in Dweck's self theory and the concept of the growth mindset. The growth mindset is an implicit belief held by an individual that intelligence and abilities are changeable, rather than fixed and immutable. In this paper, we present an overview of the growth mindset and how it aligns with the goals of CBME. We describe the challenges associated with shifting away from the fixed mindset of most traditional medical education assumptions and practices and discuss potential solutions and strategies at the individual, relational, and systems levels. Finally, we present future directions for research to better understand the growth mindset in the context of CBME.

Questioning medical competence: Should the Covid-19 crisis affect the goals of medical education?

The COVID-19 pandemic has disrupted many societal institutions, including health care and education. Although the pandemic's impact was initially assumed to be temporary, there is growing conviction that medical education might change more permanently. The International Competency-based Medical Education (ICBME) collaborators, scholars devoted to improving physician training, deliberated how the pandemic raises questions about medical competence. We formulated 12 broad-reaching issues for discussion, grouped into micro-, meso-, and macro-level questions. At the individual micro level, we ask questions about adaptability, coping with uncertainty, and the value and limitations of clinical courage. At the institutional meso level, we question whether curricula could include more than core entrustable professional activities (EPAs) and focus on individualized, dynamic, and adaptable portfolios of EPAs that, at any moment, reflect current competence and preparedness for disasters. At the regulatory and societal macro level, should conditions for licensing be reconsidered? Should rules of liability be adapted to match the need for rapid redeployment? We do not propose a blueprint for the future of medical training but rather aim to provoke discussions needed to build a workforce that is competent to cope with future health care crises.

Clarifying essential terminology in entrustment.

With the rapid uptake of entrustable professional activties and entrustment decision-making as an approach in undergraduate and graduate education in medicine and other health professions, there is a risk of confusion in the use of new terminologies. The authors seek to clarify the use of many words related to the concept of entrustment, based on existing literature, with the aim to establish logical consistency in their use. The list of proposed definitions includes independence, autonomy, supervision, unsupervised practice, oversight, general and task-specific trustworthiness, trust, entrust(ment), entrustable professional activity, entrustment decision, entrustability, entrustment-supervision scale, retrospective and prospective entrustment-supervision scales, and entrustment-based discussion. The authors conclude that a shared understanding of the language around entrustment is critical to strengthen bridges among stages of training and practice, such as undergraduate medical education, graduate medical education, and continuing professional development. Shared language and understanding provide the foundation for consistency in interpretation and implementation across the educational continuum.

Perceptions of family medicine in Canada through the eyes of learners.

OBJECTIVE: To examine the perceptions of family medicine (FM) residents about their chosen specialty and how they perceive that patients, other specialists, and the government value FM. DESIGN: Self-report data from the Family Medicine Longitudinal Survey collected from 2014 (time 1 [T1]) to 2016 (time 2 [T2]). SETTING: Canada. PARTICIPANTS: Family medicine residents from 16 out of the 17 FM residency programs. MAIN OUTCOME MEASURES: Responses to statements in the survey were evaluated using a 5-point Likert scale (from strongly disagree to strongly agree). Data were analyzed in 2 ways: cross sectionally (participation in either T1 or T2), and longitudinally (participation in both T1 and T2). RESULTS: For both the cross-sectional cohorts (T1, n = 916; T2, n = 785) and the repeated-measures cohort (n = 420), most residents responded positively to feeling proud of becoming a family physician, with little change from entrance to exit. For both cohorts, a higher proportion of residents at the end of training reported that other medical specialists value the contributions of family physicians (P < .001); however, fewer believed that the government perceived FM as essential to the health care system (P < .001). CONCLUSION: Most participating Canadian FM residents feel proud to become family physicians. This feeling may come from the perceptions of others who are believed to value FM, including other specialists. Measuring attitudinal perceptions offers a window to discover how FM is viewed and can offer a way to measure the effect of strategies implemented to advance the discipline of FM.

Development of the Inner City attitudinal assessment tool (ICAAT) for learners across Health care professions.

BACKGROUND: Many health professions learners report feeling uncomfortable and underprepared for professional interactions with inner city populations. These learners may hold preconceptions which affect therapeutic relationships and provision of care. Few tools exist to measure learner attitudes towards these populations. This article describes the development and validity evidence behind a new tool measuring health professions learner attitudes toward inner city populations. METHODS: Tool development consisted of four phases: 1) Item identification and generation informed by a scoping review of the literature; 2) Item refinement involving a two stage modified Delphi process with a national multidisciplinary team (n = 8), followed by evaluation of readability and response process validity with a focus group of medical and nursing students (n = 13); 3) Pilot testing with a cohort of medical and nursing students; and 4) Analysis of psychometric properties through factor analysis and reliability. RESULTS: A 36-item online version of the Inner City Attitudinal Assessment Tool (ICAAT) was completed by 214 of 1452 undergraduate students (67.7% from medicine; 32.3% from nursing; response rate 15%). The resulting tool consists of 24 items within a three-factor model - affective, behavioural, and cognitive. Reliability (internal consistency) values using Cronbach alpha were 0.87, 0.82, and 0.82 respectively. The reliability of the whole 24-item ICAAT was 0.90. CONCLUSIONS: The Inner City Attitudinal Assessment Tool (ICAAT) is a novel tool with evidence to support its use in assessing health care learners' attitudes towards caring for inner city populations. This tool has potential to help guide curricula in inner city health.

Medical student well-being and lifelong learning: A motivational perspective.

Background: Medical school poses many pressures and challenges for individuals aspiring to health careers. Only some students, however, experience high stress and exhaustion, whereas others adaptively respond to schooling demands and engage in lifelong learning practices. By drawing on three motivation theories - self-determination theory, self-theories of ability, and achievement goal theory - this study examined the relations among motivational constructs, stress, exhaustion, and lifelong learning in medical students. Methods: All medical students in a 4-year program were invited to complete a questionnaire containing measures of psychological need satisfaction, self-theories of ability, achievement goals, stress, exhaustion, lifelong learning, and background characteristics. Using structural equation modeling, we tested a structural model that combined the three motivation theories to explain stress, exhaustion, and lifelong learning in medical students. Results: A total of 267 medical students participated in the study (response rate 42%). The results largely confirmed the hypothesized relations, revealing that unmet psychological needs and a fixed mind-set were associated with maladaptive cognitions (i.e., the pursuit of avoidance goals) and psychological distress (i.e., high stress and exhaustion). In contrast, psychological need satisfaction and a growth mind-set had distinct pathways to beneficial cognitions (i.e., mastery approach goals) and lifelong learning practices in medical students. Discussion: Adaptive motivations, cultivated through personal and environmental factors, may help to protect medical students from psychological distress and enhance their growth as lifelong learners. Understanding the mechanisms and pathways to desirable and undesirable outcomes in medical students is critical for creating learning environments that will serve these students well.

Unexpected result of competency-based medical education: 9-year application trends to enhanced skills programs by family medicine residents at a single institution in Canada.

In Canada, family physicians may pursue extended training for added competence in areas such as Palliative Care or Emergency Medicine by applying to Enhanced Skills (ES) programmes. Despite the increasing popularity of ES programmes, there are no studies that examine trends in applications to ES programmes before and after the introduction of family medicine focused competency-based curricula at individual universities. Additionally, there is a scarcity of research examining factors common among applicants to ES programmes. We undertook a retrospective observational study using secondary data analysis of archived resident files from a large Canadian family medicine residency programme. The proportion of applicants to ES programmes decreased since implementation of a competency-based curriculum in the subject programme. Older, male, and Canadian medical graduates (CMGs) applied to ES programmes more often than their respective counterparts. Residents in a family medicine competency-based curriculum may be less inclined to extend their training by applying to ES programmes. This is remarkable considering that the Canadian residency programme is the shortest among high-income countries. Further studies are needed to investigate the role of competency-based medical education programmes in enabling shortening residency training around the world.

Future practice of comprehensive care: Practice intentions of exiting family medicine residents in Canada.

OBJECTIVE: To describe exiting family medicine (FM) residents' reported practice intentions after completing a Triple C Competency-based Curriculum. DESIGN: The surveys were intended to capture residents' perceptions of FM, their perceptions of their competency-based training, and their intentions to practise FM. Entry (T1) and exit (T2) self-reported survey results were compared considering the influence of the curriculum change. Unmatched aggregate-level data were reviewed. The T1 survey was administered in the summer of 2012 and the T2 survey was administered in the spring of 2014. SETTING: Six Canadian FM residency programs across 4 provinces in Canada (Alberta, Saskatchewan, Ontario, and Quebec). PARTICIPANTS: Overall, 341 entering FM residents in 2012 responded to the T1 survey and 325 exiting FM residents completing their residency programs in spring 2014 responded to the T2 survey. MAIN OUTCOME MEASURES: Self-reported data on FM residents' future practice intentions related to comprehensive care, providing care across clinical domains and settings, and providing comprehensive care individually or in teams. RESULTS: A total of 341 (71.3%) residents responded to the T1 survey and a total of 325 (71.4%) residents responded to the T2 survey. Of these, 78.7% responded that they intended to provide comprehensive FM in multiple clinical settings in their future practices, with 70.8% indicating a comprehensive care practice with a special interest and 36.6% intending to provide care in a focused practice. Overall, 92.9% reported that they intended to work in group practice environments. Ninety percent reported they intended to work in interprofessional team practices. CONCLUSION: While an upward trend toward the practice of comprehensive care was demonstrated, findings also showed an increased trend toward providing care in focused practices. Further research is needed to better determine how FM residents understand the definition of comprehensive FM and its practice models. The survey provides an opportunity to explore questions related to practice intentions that could be helpful in work force planning. As the first study to compare entry and exit data from learners who have been exposed to a Triple C competency-based approach, this survey provides important baseline data for use by many.

Toward a shared language for competency-based medical education.

The paradigm shift brought about by the advent of competency-based medical education (CBME) can be characterized as an adaptive change. Currently, its development and implementation suffer from the lack of a lingua franca. A shared language is needed to support collaboration and dissemination across the world community of medical educators. The International CBME Collaborators held a second summit in 2013 to explore this and other contemporary CBME issues. We present the resulting International CBME Collaborator's glossary of CBME terms. Particular attention is given to the terms competency, entrustable professional activity (EPA), and milestone and their interrelationships. Medical education scholars and enthusiasts of the competency-based approach are encouraged to adopt these terms and definitions, although no doubt the vocabulary of CBME will continue to evolve.

Evolving concepts of assessment in a competency-based world.

Competency-based medical education (CBME) is an approach to the design of educational systems or curricula that focuses on graduate abilities or competencies. It has been adopted in many jurisdictions, and in recent years an explosion of publications has examined its implementation and provided a critique of the approach. Assessment in a CBME context is often based on observations or judgments about an individual's level of expertise; it emphasizes frequent, direct observation of performance along with constructive and timely feedback to ensure that learners, including clinicians, have the expertise they need to perform entrusted tasks. This paper explores recent developments since the publication in 2010 of Holmboe and colleagues' description of CBME assessment. Seven themes regarding assessment that arose at the second invitational summit on CBME, held in 2013, are described: competency frameworks, the reconceptualization of validity, qualitative methods, milestones, feedback, assessment processes, and assessment across the medical education continuum. Medical educators interested in CBME, or assessment more generally, should consider the implications for their practice of the review of these emerging concepts.